Undergraduate Texts in Mathematics 




Elementary Analysis 

The Theory of Calculus 
Second Edition 



springer 



Undergraduate Texts in Mathematics 



http://avaxho.me/blogs/ChrisRedfield 



Undergraduate Texts in Mathematics 



Series Editors: 

Sheldon Axler 

San Francisco State University, San Francisco, CA, USA 
Kenneth Ribet 

University of California, Berkeley, CA, USA 



Advisory Board: 

Cohn C. Adams, Williams College, Williamstown, MA, USA 

Alejandro Adem, University of British Columbia, Vancouver, BC, Canada 

Ruth Charney, Brandeis University, Waltham, MA, USA 

Irene M. Gamba, The University of Texas at Austin, Austin, TX, USA 

Roger E. Howe, Yale University, New Haven, CT, USA 

David Jerison, Massachusetts Institute of Technology, Cambridge, MA, USA 

Jeffrey C. Lagarias, University of Michigan, Ann Arbor, MI, USA 

Jill Pipher, Brown University, Providence, RI, USA 

Fadil Santosa, University of Minnesota, Minneapolis, MN, USA 

Amie Wilkinson, University of Chicago, Chicago, IL, USA 



Undergraduate Texts in Mathematics are generally aimed at third- and fourth- 
year undergraduate mathematics students at North American universities. These texts 
strive to provide students and teachers with new perspectives and novel approaches. 
The books include motivation that guides the reader to an appreciation of interrela- 
tions among different aspects of the subject. They feature examples that illustrate key 
concepts as well as exercises that strengthen understanding. 



For further volumes: 
http://www.springer.com/series/666 



Kenneth A. Ross 



Elementary Analysis 

The Theory of Calculus 

Second Edition 

In collaboration with Jorge M. Lopez, University of 
Puerto Rico, Rio Piedras 



Springer 





Kenneth A. Ross 
Department of Mathematics 
University of Oregon 
Eugene, OR, USA 



ISSN 0172-6056 

ISBN 978-1-4614-6270-5 ISBN 978-1-4614-6271-2 (eBook) 

DOI 10.1007/978-1-4614-6271-2 

Springer New York Heidelberg Dordrecht London 

Library of Congress Control Number: 2013950414 

Mathematics Subject Classification: 26-01, 00-01, 26A06, 26A24, 26A27, 26A42 
© Springer Science-i-Business Media New York 2013 

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part 
of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, 
recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or 
information storage and retrieval, electronic adaptation, computer software, or by similar or dissim- 
ilar methodology now known or hereafter developed. Exempted from this legal reservation are brief 
excerpts in connection with reviews or scholarly analysis or material supplied specifically for the pur- 
pose of being entered and executed on a computer system, for exclusive use by the purchaser of the 
work. Duplication of this publication or parts thereof is permitted only under the provisions of the 
Copyright Law of the Publisher's location, in its current version, and permission for use must always 
be obtained from Springer Permissions for use may be obtained through RightsLink at the Copyright 
Clearance Center Violations are liable to prosecution under the respective Copyright Law. 
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publi- 
cation does not imply, even in the absence of a specific statement, that such names are exempt from 
the relevant protective laws and regulations and therefore free for general use. 
While the advice and information in this book are believed to be true and accurate at the date of 
publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for 
any errors or omissions that may be made. The publisher makes no warranty, express or implied, with 
respect to the material contained herein. 

Printed on acid-free paper 

Springer is part of Springer Science-i-Business Media (www. springer com) 



Preface 



Preface to the First Edition A study of this book, and espe- 
cially the exercises, should give the reader a thorough understanding 
of a few basic concepts in analysis such as continuity, convergence 
of sequences and series of numbers, and convergence of sequences 
and series of functions. An ability to read and write proofs will 
be stressed. A precise knowledge of definitions is essential. The be- 
ginner should memorize them; such memorization will help lead to 
understanding. 

Chapter 1 sets the scene and, except for the completeness axiom, 
should be more or less familiar. Accordingly, readers and instructors 
are urged to move quickly through this chapter and refer back to it 
when necessary. The most critical sections in the book are §§7-12 in 
Chap. 2. If these sections are thoroughly digested and understood, 
the remainder of the book should be smooth sailing. 

The first four chapters form a unit for a short course on analysis. 
I cover these four chapters (except for the enrichment sections and 
§20) in about 38 class periods; this includes time for quizzes and 
examinations. For such a short course, my philosophy is that the 
students are relatively comfortable with derivatives and integrals but 
do not really understand sequences and series, much less sequences 
and series of functions, so Chaps. 1-4 focus on these topics. On two 
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or three occasions, I draw on the Fundamental Theorem of Calculus 
or the Mean Value Theorem, which appears later in the book, but of 
course these important theorems are at least discussed in a standard 
calculus class. 

In the early sections, especially in Chap. 2, the proofs are very 
detailed with careful references for even the most elementary facts. 
Most sophisticated readers find excessive details and references a 
hindrance (they break the flow of the proof and tend to obscure the 
main ideas) and would prefer to check the items mentally as they 
proceed. Accordingly, in later chapters, the proofs will be somewhat 
less detailed, and references for the simplest facts will often be omit- 
ted. This should help prepare the reader for more advanced books 
which frequently give very brief arguments. 

Mastery of the basic concepts in this book should make the 
analysis in such areas as complex variables, differential equations, 
numerical analysis, and statistics more meaningful. The book can 
also serve as a foundation for an in-depth study of real analysis 
given in books such as [4,33,34,53,62,65] listed in the bibliography. 

Readers planning to teach calculus will also benefit from a careful 
study of analysis. Even after studying this book (or writing it), it will 
not be easy to handle questions such as "What is a number?" but 
at least this book should help give a clearer picture of the subtleties 
to which such questions lead. 

The enrichment sections contain discussions of some topics that I 
think are important or interesting. Sometimes the topic is dealt with 
lightly, and suggestions for further reading are given. Though these 
sections are not particularly designed for classroom use, I hope that 
some readers will use them to broaden their horizons and see how 
this material fits in the general scheme of things. 

I have benefitted from numerous helpful suggestions from my col- 
leagues Robert Freeman, William Kantor, Richard Koch, and John 
Leahy and from Timothy Hall, Gimli Khazad, and Jorge Lopez. I 
have also had helpful conversations with my wife Lynn concerning 
grammar and taste. Of course, remaining errors in grammar and 
mathematics are the responsibility of the author. 

Several users have supplied me with corrections and suggestions 
that Fve incorporated in subsequent printings. I thank them all. 
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including Robert Messer of Albion College, who caught a subtle error 
in the proof of Theorem 12.1. 

Preface to the Second Edition After 32 years, it seemed time 
to revise this book. Since the first edition was so successful, I have 
retained the format and material from the first edition. The num- 
bering of theorems, examples, and exercises in each section will be 
the same, and new material will be added to some of the sections. 
Every rule has an exception, and this rule is no exception. In §11, 
a theorem (Theorem 11.2) has been added, which allows the sim- 
plification of four almost-identical proofs in the section: Examples 3 
and 4, Theorem 11.7 (formerly Corollary 11.4), and Theorem 11.8 
(formerly Theorem 11.7). 

Where appropriate, the presentation has been improved. See es- 
pecially the proof of the Chain Rule 28.4, the shorter proof of Abel's 
Theorem 26.6, and the shorter treatment of decimal expansions in 
§16. Also, a few examples have been added, a few exercises have been 
modified or added, and a couple of exercises have been deleted. 

Here are the main additions to this revision. The proof of the 
irrationality of e in §16 is now accompanied by an elegant proof that 
TT is also irrational. Even though this is an "enrichment" section, 
it is especially recommended for those who teach or will teach pre- 
college mathematics. The Baire Category Theorem and interesting 
consequences have been added to the enrichment §21. Section 31, on 
Taylor's Theorem, has been overhauled. It now includes a discussion 
of Newton's method for approximating zeros of functions, as well 
as its cousin, the secant method. Proofs are provided for theorems 
that guarantee when these approximation methods work. Section 35 
on Riemann-Stieltjes integrals has been improved and expanded. 
A new section, §38, contains an example of a continuous nowhere- 
differentiable function and a theorem that shows "most" continuous 
functions are nowhere different iable. Also, each of §§22, 32, and 33 
has been modestly enhanced. 

It is a pleasure to thank many people who have helped over 
the years since the first edition appeared in 1980. This includes 
David M. Bloom, Robert B. Burckel, Kai Lai Chung, Mark Dalthorp 
(grandson), M. K. Das (India), Richard Dowds, Ray Hoobler, 
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Richard M. Koch, Lisa J. Madsen, Pablo V. Negron Marrero 
(Puerto Rico), Rajiv Monsurate (India), Theodore W. Palmer, Jiirg 
Ratz (Switzerland), Peter Renz, Karl Stromberg, and Jesiis Sueiras 
(Puerto Rico). 

Special thanks go to my collaborator, Jorge M. Lopez, who pro- 
vided a huge amount of help and support with the revision. Working 
with him was also a lot of fun. My plan to revise the book was sup- 
ported from the beginning by my wife, Ruth Madsen Ross. Finally, 
I thank my editor at Springer, Kaitlin Leach, who was attentive to 
my needs whenever they arose. 

Especially for the Student: Don't be dismayed if you run into 
material that doesn't make sense, for whatever reason. It happens 
to all of us. Just tentatively accept the result as true, set it aside as 
something to return to, and forge ahead. Also, don't forget to use the 
Index or Symbols Index if some terminology or notation is puzzling. 
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CHAPTER 



Introduction 



The underlying space for all the analysis in this book is the set of 
real numbers. In this chapter we set down some basic properties of 
this set. These properties will serve as our axioms in the sense that 
it is possible to derive all the properties of the real numbers using 
only these axioms. However, we will avoid getting bogged down in 
this endeavor. Some readers may wish to refer to the appendix on 
set notation. 



§1 The Set N of Natural Numbers 

We denote the set {1,2,3,...} of all positive integers by N. Each 
positive integer n has a successor, namely n + 1. Thus the successor 
of 2 is 3, and 37 is the successor of 36. You will probably agree that 
the following properties of N are obvious; at least the first four are. 

Nl. 1 belongs to N. 

N2. If n belongs to N, then its successor n + 1 belongs to N. 
N3. 1 is not the successor of any element in N. 
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2 1. Introduction 

N4. If n and m in N have the same successor, then n = m. 
N5. A subset of N which contains 1, and which contains n + 1 
whenever it contains n, must equal N. 

Properties Nl through N5 are known as the Peano Axioms or 
Peano Postulates. It turns out most famihar properties of N can be 
proved based on these five axioms; see [8] or [39]. 

Let's focus our attention on axiom N5, the one axiom that may 
not be obvious. Here is what the axiom is saying. Consider a subset 
5 of N as described in N5. Then 1 belongs to S. Since S contains 
n + 1 whenever it contains n, it follows that S contains 2 = 1 + 1. 
Again, since S contains n + 1 whenever it contains n, it follows that 
S contains 3 = 2 + 1. Once again, since S contains n + 1 whenever it 
contains n, it follows that S contains 4 = 3+1. We could continue this 
monotonous line of reasoning to conclude S contains any number in 
N. Thus it seems reasonable to conclude 5 = N. It is this reasonable 
conclusion that is asserted by axiom N5. 

Here is another way to view axiom N5. Assume axiom N5 is false. 
Then N contains a set S such that 

(i) 1 ^ 5, 

(ii) If n G 5, then n + 1 G 5, 

and yet S ^ N. Consider the smallest member of the set {n G N : 
n 0 5}, call it no- Since (i) holds, it is clear no ^ 1. So no is a 
successor to some number in N, namely no — 1. We have no — 1 G 5 
since no is the smallest member of {n G N : n 0 5}. By (ii), the 
successor of no — 1, namely no, is also in 5, which is a contradiction. 
This discussion may be plausible, but we emphasize that we have not 
proved axiom N5 using the successor notion and axioms Nl through 
N4, because we implicitly used two unproven facts. We assumed 
every nonempty subset of N contains a least element and we assumed 
that if no ^ 1 then no is the successor to some number in N. 

Axiom N5 is the basis of mathematical induction. Let ^1,^2, 
P3,... be a list of statements or propositions that may or may 
not be true. The principle of mathematical induction asserts all the 
statements Pi, P2, Ps, . . . are true provided 

(11) Pi is true, 

(12) Pn+i is true whenever is true. 
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We will refer to (Ii), i.e., the fact that Pi is true, as the basis for 
induction and we will refer to (I2) as the induction step. For a sound 
proof based on mathematical induction, properties (Ii) and (I2) must 
both be verified. In practice, (Ii) will be easy to check. 

Example 1 

Prove 1 + 2 + • • • + n = ^n{n + 1) for positive integers n. □ 
Solution 

Our nth proposition is 

P^:"l + 2 + ... + n= + 

Thus Pi asserts 1 = ^ • 1(1 + 1), P2 asserts 1 + 2 = ^ • 2(2 + 1), P37 
asserts l + 2 + -- -+37=^ - 37(37 + 1) = 703, etc. In particular. Pi 
is a true assertion which serves as our basis for induction. 

For the induction step, suppose Pn is true. That is, we suppose 

1 + 2H hn= ^n(n+l) 

is true. Since we wish to prove P^+i from this, we add n + 1 to both 
sides to obtain 

l + 2 + -- -+ n+(n + l) = ln{n + 1) + (n + 1) 

= l[n{n + 1) + 2(n + 1)] = ^(n + l)(n + 2) 
= ^(n + l)((n + l) + l). 

Thus Pn+i holds if Pn holds. By the principle of mathematical 
induction, we conclude P^ is true for all n. □ 

We emphasize that prior to the last sentence of our solution we 
did not prove "P^+i is true." We merely proved an implication: "if P^ 
is true, then P^+i is true." In a sense we proved an infinite number 
of assertions, namely: Pi is true; if Pi is true then P2 is true; if P2 
is true then P3 is true; if P3 is true then P4 is true; etc. Then we 
applied mathematical induction to conclude Pi is true, P2 is true, P3 
is true, P4 is true, etc. We also confess that formulas like the one just 
proved are easier to prove than to discover. It can be a tricky matter 
to guess such a result. Sometimes results such as this are discovered 
by trial and error. 
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Example 2 

All numbers of the form 5^ — 4n — 1 are divisible by 16. □ 
Solution 

More precisely, we show 5^ — 4n — 1 is divisible by 16 for each n in 
N. Our nth proposition is 

Pn. "5^ -4.71-1 is divisible by 16." 

The basis for induction Pi is clearly true, since 5^— 4-1 — 1 = 0. 
Proposition P2 is also true because 5^ — 4-2 — 1 = 16, but note 
we didn't need to check this case before proceeding to the induction 
step. For the induction step, suppose Pn is true. To verify Pn+ii the 
trick is to write 

5^+^ - 4(n + 1) - 1 = 5(5^ - 4n - 1) + 16n. 

Since 5^ — 4n — 1 is a multiple of 16 by the induction hypothesis, it 
follows that 5^^^ — 4(n + 1) — 1 is also a multiple of 16. In fact, if 
5^-4n- 1 16m, then 5^+-^ -4(n + l) - 1 = 16- (5m + We have 
shown Pn implies Pn+i, so the induction step holds. An application 
of mathematical induction completes the proof. □ 

Example 3 

Show |sinnx| < n|sinx| for all positive integers n and all real 
numbers x. □ 

Solution 

Our nth proposition is 

Pn'. "I sinnx| < n \ sinx\ for all real numbers x." 

The basis for induction is again clear. Suppose Pn is true. We apply 
the addition formula for sine to obtain 

I sin(n + l)x\ = | sin(nx + x)| = | sinnxcosx + cosnxsinx|. 

Now we apply the Triangle Inequality and properties of the absolute 
value [see Theorems 3.7 and 3.5] to obtain 

I sin(n + l)x\ < \ sinnx| • | cosx| + | cosnx\ • \ sinx|. 

Since | cos^| < 1 for all y we see that 

I sin(n + l)x\ < \ sinnx| + | sinx|. 



Exercises ^ 

Now we apply the induction hypothesis Pn to obtain 

I sin(n + l)x\ < n\ sinx] + | sinx| = (n + 1)| sinx|. 

Thus Pn+i holds. Finally, the result holds for all n by mathematical 
induction. □ 



Exercises 

1.1 Prove 1^ + 2^ + • • • + = |n(n + l)(2n + 1) for all positive integers n. 

1.2 Prove 3 + 11 + • • • + (8n — 5) = 4n^ — n for all positive integers n. 

1.3 Prove 1^ + 2^ + • • • + = (1 + 2 + • • • + n)^ for all positive integers n. 

1.4 (a) Guess a formula for 1 + 3 H h (2n — 1) by evaluating the sum 

for n = 1, 2, 3, and 4. [For n = 1, the sum is simply 1.] 

(b) Prove your formula using mathematical induction. 

1.5 Prove 1 + ^ + | H + ^ = 2 — ^ for all positive integers n. 

1.6 Prove (11)^ —4^ is divisible by 7 when n is a positive integer. 

1.7 Prove 7^ — 6n — 1 is divisible by 36 for all positive integers n. 

1.8 The principle of mathematical induction can be extended as follows. 
A list 

Pmi Pm+ii ... of propositions is true provided (i) Pjn is true, 
(ii) Pn+i is true whenever Pn is true and n > m. 

(a) Prove > n + 1 for all integers n > 2. 

(b) Prove n! > for all integers n > 4. [Recall n! = n{n — 1) • • • 2 • 1; 
for example, 5! = 5- 4- 3- 2- l = 120.] 

1.9 (a) Decide for which integers the inequality 2^ > is true, 
(b) Prove your claim in (a) by mathematical induction. 

1.10 Prove (2n + 1) + (2n + 3) + (2n + 5) + • • • + (4n - 1) = 3n^ for all 
positive integers n. 

1.11 For each n G N, let Pn denote the assertion "n^ + 5n + 1 is an even 
integer." 

(a) Prove Pn+i is true whenever Pn is true. 

(b) For which n is Pn actually true? What is the moral of this 
exercise? 
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1.12 For n G N, let n! [read "n factorial"] denote the product 1 • 2 • 3 • • • n. 
Also let 0! = 1 and define 

{t)-i^. "■ " 

The binomial theorem asserts that 

,.«,»K;>".Q."-...Q.-.«.....(;:>r-..Or 

=a"+na"-i6+^n(n-l)a"-262+ • • • +na6"-i+6^. 

(a) Verify the binomial theorem for n = 1, 2, and 3. 

(b) Showa) + (,^) = rr)forfc = l,2,...,n. 

(c) Prove the binomial theorem using mathematical induction and 
part (b). 



§2 The Set Q of Rational Numbers 

Small children first learn to add and to multiply positive integers. 
After subtraction is introduced, the need to expand the number sys- 
tem to include 0 and negative integers becomes apparent. At this 
point the world of numbers is enlarged to include the set Z of all 
integers. Thus we have Z = {0, 1, —1, 2, —2, . . .}. 

Soon the space Z also becomes inadequate when division is in- 
troduced. The solution is to enlarge the world of numbers to include 
all fractions. Accordingly, we study the space Q of all rational num- 
bers, i.e., numbers of the form ^ where m,n ^"L and n ^ 0. Note 
that Q contains all terminating decimals such as 1.492 = The 
connection between decimals and real numbers is discussed in 10.3 
on page 58 and in §16. The space Q is a highly satisfactory alge- 
braic system in which the basic operations addition, multiplication, 
subtraction and division can be fully studied. No system is perfect, 
however, and Q is inadequate in some ways. In this section we will 
consider the defects of Q. In the next section we will stress the good 
features of Q and then move on to the system of real numbers. 

The set Q of rational numbers is a very nice algebraic system until 
one tries to solve equations like = 2. It turns out that no rational 
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FIGURE 2.1 



number satisfies this equation, and yet there are good reasons to 
believe some kind of number satisfies this equation. Consider, for 
example, a square with sides having length one; see Fig. 2.1. If d is 
the length of the diagonal, then from geometry we know 1^ + 1^ = (P, 
i.e., (P = 2. Apparently there is a positive length whose square is 2, 
which we write as \/2- But \/2 cannot be a rational number, as we will 
show in Example 2. Of course, \/2 can be approximated by rational 
numbers. There are rational numbers whose squares are close to 2; 
for example, (1.4142)^ = 1.99996164 and (1.4143)^ = 2.00024449. 

It is evident that there are lots of rational numbers and yet there 
are "gaps" in Q. Here is another way to view this situation. Consider 
the graph of the polynomial Fig. 2.2. Does the graph ofx —2 

cross the x-axis? We are inclined to say it does, because when we 
draw the x-axis we include "all" the points. We allow no "gaps." But 
notice that the graph of — 2 slips by all the rational numbers on 
the X-axis. The x-axis is our picture of the number line, and the set 
of rational numbers again appears to have significant "gaps." 

There are even more exotic numbers such as tt and e that are not 
rational numbers, but which come up naturally in mathematics. The 
number tt is basic to the study of circles and spheres, and e arises in 
problems of exponential growth. 

We return to \/2. This is an example of what is called an algebraic 
number because it satisfies the equation — 2 = 0. 
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FIGURE 2.2 

2.1 Definition. 

A number is called an algebraic number if it satisfies a polynomial 
equation 

CnX^ + Cn-lX^~^ H h CiX + Cq = 0 

where the coefficients cq, ci, . . . , are integers, 7^ 0 and n > 1. 

Rational numbers are always algebraic numbers. In fact, if r = ^ 
is a rational number [m,n G Z and n ^ 0], then it satisfies the 
equation nx — m = 0. Numbers defined in terms of V^, v^, etc. [or 
fractional exponents, if you prefer] and ordinary algebraic operations 
on the rational numbers are invariably algebraic numbers. 

Example 1 

^, a/3, v^Tz, \/2 + and ^J ^~'^'^ are algebraic numbers. In fact, 

^ is a solution of 17x — 4 = 0, \/3 is a solution of — 3 = 0, and 

vlT is a solution of - 17 = 0. The expression a = means 
a2 = 2 + or - 2 = so that (a^ - 2)^ = 5. Therefore we 
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have — 6a^ + 12a^ — 13 = 0, which shows a = \/2 + \/5 satisfies 
the polynomial equation — + 12x^ — 13 = 0. 

Similarly, the expression b = ^J ^~'^'^ leads to 7P = 4 — 2\/3, 
hence 2x/3 = 4-76^, hence 12 = (4-76^)2, hence 496^-5662+4 = 0. 
Thus 6 satisfies the polynomial equation 49x^ — 56x^ + 4 = 0. □ 

The next theorem may be familiar from elementary algebra. It is 
the theorem that justifies the following remarks: the only possible ra- 
tional solutions of x^-7x2 + 2x-12 = 0 are ±1, ±2, ±3, ±4, ±6, ±12, 
so the only possible (rational) monomial factors of x^ — Ix^ + 2x — 12 
are x — 1, x + 1, x — 2, x + 2, x — 3, x + 3, x — 4, x + 4, x — 6, x + 6, 
X — 12, x + 12. We won't pursue these algebraic problems; we merely 
make these observations in the hope they will be familiar. 

The next theorem also allows one to prove algebraic numbers that 
do not look like rational numbers are usually not rational numbers. 
Thus \/4 is obviously a rational number, while a/2, \/3, \/5, etc. 
turn out to be nonrational. See the examples following the theorem. 
Also, compare Exercise 2.7. Recall that an integer A; is a factor of an 
integer m or divides m if ^ is also an integer. 

If the next theorem seems complicated, first read the special case 
in Corollary 2.3 and Examples 2-5. 

2.2 Rational Zeros Theorem. 

Suppose co,ci,...,c^ are integers and r is a rational number 
satisfying the polynomial equation 

CnX"" + Cn-ix''~^ H h CiX + Cq = 0 (l) 

where n > 1, Cn 0 and cq ^ 0. Let t — ^ where c, d are inte- 
gers having no common factors and d ^ 0. Then c divides cq and d 
divides 0^. 

In other words, the only rational candidates for solutions of (1) 
have the form ^ where c divides cq and d divides c^. 

Proof 

We are given 
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We multiply through by and obtain 

c„c" + c„_ic"-id + c„_2c"-2d2 + - ■ - + 0202 d"-2 + cicd"-i + cod" = 0. 

(2) 

If we solve for cqc?^, we obtain 

It follows that c divides cod^. But c and have no common factors, 
so c divides cq. This follows from the basic fact that if an integer 
c divides a product ab of integers, and if c and b have no common 
factors, then c divides a. See, for example. Theorem 1.10 in [50]. 
Now we solve (2) for c^c^ and obtain 

Thus d divides c^c^. Since and d have no common factors, 
d divides c^. ■ 

2.3 Corollary. 

Consider the polynomial equation 

x"" + Cn-ix""'^ H h CiX + Co = 0, 

where the coefficients cq, ci, . . . , Cn-i are integers and cq O} Any 
rational solution of this equation must be an integer that divides cq. 

Proof 

In the Rational Zeros Theorem 2.2, the denominator of r must divide 
the coefficient of x^, which is 1 in this case. Thus r is an integer and 
it divides cq. ■ 

Example 2 

\/2 is not a rational number. □ 
Proof 

By Corollary 2.3, the only rational numbers that could possibly be 
solutions of — 2 = 0 are ±1,±2. [Here n = 2, C2 = 1, ci = 0, 
Co = —2. So the rational solutions have the form ^ where c divides 



^Polynomials like this, where the highest power has coefficient 1, are called monic 
polynomials. 
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Co = — 2 and d divides C2 = 1.] One can substitute each of the four 
numbers ±1,±2 into the equation — 2 = 0 to quickly ehminate 
them as possible solutions of the equation. Since \/2 is a solution of 
— 2 = 0, it cannot be a rational number. ■ 

Example 3 

VTz is not a rational number. □ 
Proof 

The only possible rational solutions of — 17 = 0 are ±1, ±17, and 
none of these numbers are solutions. ■ 

Example 4 

is not a rational number. □ 
Proof 

The only possible rational solutions of — 6 = 0 are ±1, ±2, ±3, ±6. 
It is easy to verify that none of these eight numbers satisfies the 
equation — 6 = 0. ■ 

Example 5 



is not a rational number. □ 

Proof 

In Example 1 we showed a is a solution of - 6x^ + 12^^ -13 = 0. 
By Corollary 2.3, the only possible rational solutions are ±1,±13. 
When X = 1 or —1, the left hand side of the equation is —6 and 
when x = 13or— 13, the left hand side of the equation turns out to 
equal 4,657,458. This last computation could be avoided by using a 
little common sense. Either observe a is "obviously" bigger than 1 
and less than 13, or observe 

13^ - 6 • 13^ + 12 • 13^ - 13 = 13(13^ - 6 • 13^ + 12 • 13 - 1) 7^ 0 

since the term in parentheses cannot be zero: it is one less than some 
multiple of 13. ■ 

Example 6 

b = \/ is not a rational number. □ 
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Proof 

In Example 1 we showed 6 is a solution of 49x^ - SGx^ + 4 = 0. By 
Theorem 2.2, the only possible rational solutions are 

±1, ±1/7, ±1/49, ±2, ±2/7, ±2/49, ±4, ±4/7, ±4/49. 

To complete our proof, all we need to do is substitute these 18 can- 
didates into the equation 49x^ — 56x^ + 4 = 0. This prospect is 
so discouraging, however, that we choose to find a more clever ap- 
proach. In Example 1, we also showed 12 = (4 — 76^)^. Now if b were 
rational, then 4 — 7P would also be rational [Exercise 2.6], so the 
equation 12 = would have a rational solution. But the only pos- 
sible rational solutions to — 12 = 0 are ±1, ±2, ±3, ±4, ±6, ±12, 
and these all can be eliminated by mentally substituting them into 
the equation. We conclude 4 — 7P cannot be rational, so b cannot 
be rational. ■ 

As a practical matter, many or all of the rational candidates given 
by the Rational Zeros Theorem can be eliminated by approximating 
the quantity in question. It is nearly obvious that the values in Ex- 
amples 2 through 5 are not integers, while all the rational candidates 
are. The number b in Example 6 is approximately 0.2767; the nearest 
rational candidate is +2/7 which is approximately 0.2857. 

It should be noted that not all irrational-looking expressions are 
actually irrational. See Exercise 2.7. 

2.4 Remark. 

While admiring the efficient Rational Zeros Theorem for finding 
rational zeros of polynomials with integer coefficients, you might 
wonder how one would find other zeros of these polynomials, or ze- 
ros of other functions. In §31, we will discuss the most well-known 
method, called Newton's method, and its cousin, the secant method. 
That discussion can be read now; only the proof of the theorem uses 
material from §31. 

Exercises 

2.1 Show \/3, \/5, \/7, \/24, and VSI are not rational numbers. 

2.2 Show v^, and are not rational numbers. 
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2.3 Show \/2 + is not a rational number. 

2.4 Show \/5 — \/3 is not a rational number. 

2.5 Show [3 + \/2]2/^ is not a rational number. 

2.6 In connection with Example 6, discuss why 4 — 76^ is rational if b is 
rational. 

2.7 Show the following irrational- looking expressions are actually rational 
numbers: (a) \/4 + 2\/3 - \/3, and (b) \/6 + 4\/2 - \/2. 

2.8 Find all rational solutions of the equation — Ax^ + 13x^ — 7x^1 = 0. 



§3 The Set M of Real Numbers 

The set Q is probably the largest system of numbers with which 
you really feel comfortable. There are some subtleties but you have 
learned to cope with them. For example, Q is not simply the set of 
symbols m/n, where m, n G Z, n ^ 0, since we regard some pairs of 
different looking fractions as equal. For example, | and | represent 
the same element of Q. A rigorous development of Q based on Z, 
which in turn is based on N, would require us to introduce the notion 
of equivalence classes. In this book we assume a familiarity with and 
understanding of Q as an algebraic system. However, in order to 
clarify exactly what we need to know about Q, we set down some of 
its basic axioms and properties. 

The basic algebraic operations in Q are addition and multiplica- 
tion. Given a pair a, b of rational numbers, the sum a + 6 and the 
product ab also represent rational numbers. Moreover, the following 
properties hold. 

Al. a + (6 + c) = (a + 6) + c for all a, 6, c. 
A2. a + 6 = 6 + a for all a, b. 
A3, a + 0 = a for all a. 

A4. For each a, there is an element —a such that a + (—a) = 0. 
Ml. a{bc) = {ab)c for all a,b,c. 
M2. ab = ba for all a, b. 
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M3. a • 1 = a for all a. 

M4. For each a ^ 0, there is an element such that aa~^ = 1. 
DL a{b + c) — ah ^ ac for all a, 6, c. 

Properties Al and Ml are called the associative laws^ and prop- 
erties A2 and M2 are the commutative laws. Property DL is the 
distributive law] this is the least obvious law and is the one that 
justifies "factorization" and "multiplying out" in algebra. A system 
that has more than one element and satisfies these nine properties is 
called a field. The basic algebraic properties of Q can proved solely 
on the basis of these field properties. We will not pursue this topic 
in any depth, but we illustrate our claim by proving some familiar 
properties in Theorem 3.1 below. 

The set Q also has an order structure < satisfying 

01. Given a and 6, either a < b oi b < a. 

02. If a < 6 and b < a^ then a = b. 

03. If a < 6 and 6 < c, then a < c. 

04. If a < 6, then a + c < 6 + c. 

05. If a < 6 and 0 < c, then ac < be. 

Property 03 is called the transitive law. This is the characteristic 
property of an ordering. A field with an ordering satisfying properties 
01 through 05 is called an ordered field. Most of the algebraic and 
order properties of Q can be established for an ordered field. We will 
prove a few of them in Theorem 3.2 below. 

The mathematical system on which we will do our analysis will 
be the set R of all real numbers. The set R will include all rational 
numbers, all algebraic numbers, tt, e, and more. It will be a set that 
can be drawn as the real number line; see Fig. 3.1. That is, every 
real number will correspond to a point on the number line, and 
every point on the number line will correspond to a real number. 
In particular, unlike Q, R will not have any "gaps." We will also 
see that real numbers have decimal expansions; see 10.3 on page 58 
and §16. These remarks help describe R, but we certainly have not 
defined R as a precise mathematical object. It turns out that R can 
be defined entirely in terms of the set Q of rational numbers; we 
indicate in the enrichment §6 one way this can be done. But then 
it is a long and tedious task to show how to add and multiply the 
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objects defined in this way and to show that the set R, with these 
operations, satisfies all the familiar algebraic and order properties 
we expect to hold for R. To develop R properly from Q in this way 
and to develop Q properly from N would take us several chapters. 
This would defeat the purpose of this book, which is to accept R as 
a mathematical system and to study some important properties of 
R and functions on R. Nevertheless, it is desirable to specify exactly 
what properties of R we are assuming. 

Real numbers, i.e., elements of R, can be added together and 
multiplied together. That is, given real numbers a and 6, the sum 
a + 6 and the product ab also represent real numbers. Moreover, these 
operations satisfy the field properties Al through A4, Ml through 
M4, and DL. The set R also has an order structure < that satisfies 
properties 01 through 05. Thus, like Q, R is an ordered field. 

In the remainder of this section, we will obtain some results for 
R that are valid in any ordered field. In particular, these results 
would be equally valid if we restricted our attention to Q. These 
remarks emphasize the similarities between R and Q. We have not 
yet indicated how R can be distinguished from Q as a mathematical 
object, although we have asserted that R has no "gaps." We will 
make this observation much more precise in the next section, and 
then we will give a "gap filling" axiom that finally will distinguish R 
from Q. 

3.1 Theorem. 

The following are consequences of the field properties: 
(i) a + c = 6 + c implies a = b; 
(ii) a • 0 = 0 for all a; 

(iii) {—a)b = —ab for all a, b; 

(iv) (—a) (—6) = ab for all a, b; 

(v) ac = be and c ^ 0 imply a = b; 
(vi) a6 = 0 implies either a = 0 or b = 0; 
for a^b^c ^ R. 
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Proof 

(i) a + c = 6 + c implies (a + c) + (— c) = (6 + c) + (— c), so by Al, 
we have a+ [c+ (— c)] = 6 + [c+ (— c)]. By A4, this reduces to 
a + 0 = 6 + 0, so a = 6 by A3. 

(ii) We use A3 and DL to obtain a-0 = a-(0 + 0) = a- 0 + a-0, 
soO + a- 0 = a- 0 + a-0. By (i) we conclude 0 = a • 0. 

(iii) Since a + (—a) = 0, we have ab + (— a)6 = [a + (—a)] • 6 = 
0 • 6 = 0 = a6 + {—{ab)). From (i) we obtain {—a)b —{ab). 

(iv) and (v) are left to Exercise 3.3. 

(vi) If a6 = 0 and 6^0, then 0 = • 0 = 0 • = {ab) • b'^ = 
a{bb-^) = a • 1 = a. ■ 

3.2 Theorem. 

The following are consequences of the properties of an ordered field: 
(i) If a <b, then —b < —a; 
(ii) If a < b and c < 0, then be < ac; 

(iii) If 0 < a and 0 < b, then 0 < ab; 

(iv) 0 < a^ for all a; 
(v) 0 < 1; 

(vi) IfO<a, then 0 < a~^ ; 

(vii) IfO<a<b, then 0 < 6"^ < a'^ ; 
for a,b,c ^ M. 

Note a < b means a < b and a ^ b. 
Proof 

(i) Suppose a < 6. By 04 applied to c = (—a) + (—6), we have 
a+[(-a) + (-6)] < 6+ [(-a) + (-6)]. It follows that -b < -a. 
(ii) If a < 6 and c < 0, then 0 < — c by (i). Now by 05 we have 
a{—c) < b{—c), i.e., —ac < —be. From (i) again, we see be < ac. 

(iii) If we put a = 0 in property 05, we obtain: 0 < 6 and 0 < c 
imply 0 < be. Except for notation, this is exactly assertion 

(iii). 

(iv) For any a, either a > 0 or a < 0 by 01. If a > 0, then > 0 
by (iii). If a < 0, then we have — a > 0 by (i), so (— a)^ > 0, 
i.e., > 0. 

(v) Is left to Exercise 3.4. 
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(vi) Suppose 0 < a but 0 < fails. Then we must have < 0 
and 0 < -a"^ Now by (hi) 0 < a(-a"^) = -1, so that 1 < 0, 
contrary to (v). 

(vii) Is left to Exercise 3.4. ■ 

Another important notion that should be familiar is that of 
absolute value. 

3.3 Definition. 

We define 

|a| = a if a > 0 and \a\ — —a if a < 0. 
\a\ is called the absolute value of a. 

Intuitively, the absolute value of a represents the distance be- 
tween 0 and a, but in fact we will define the idea of "distance" in 
terms of the "absolute value," which in turn was defined in terms of 
the ordering. 

3.4 Definition. 

For numbers a and b we define dist(a, b) = \a — b\] dist(a, b) represents 
the distance between a and b. 

The basic properties of the absolute value are given in the next 
theorem. 

3.5 Theorem. 

(i) \a\ > 0 for all a G R. 
(ii) \ab\ = \a\ • \b\ for all a, 6 G M. 
(iii) |a + 6| < \a\ + \b\ for all a, 6 G R. 

Proof 

(i) is obvious from the definition. [The word "obvious" as used 
here signifies the reader should be able to quickly see why the 
result is true. Certainly if a > 0, then \a\ = a > 0, while a < 0 
implies |a| = — a > 0. We will use expressions like "obviously" 
and "clearly" in place of very simple arguments, but we will 
not use these terms to obscure subtle points.] 
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(ii) There are four easy cases here. If a > 0 and 6 > 0, then ab > 0, 
so \a\ • |6| = ab = \ab\. If a < 0 and 6 < 0, then —a > 0, — 6 > 0 
and (— a)(— 6) > 0 so that \a\ • \b\ = (— a)(— 6) ^ ab ^ \ab\. 
If a > 0 and 6 < 0, then -6 > 0 and a(-6) > 0 so that 
\a\ ' \b\ = a{—b) — —{ab) = |a6|. If a < 0 and 6 > 0, then 
—a > 0 and {—a)b > 0 so that \a\ • \b\ = {—a)b = — a6 = |a6|. 
(iii) The inequahties — |a| < a < \a\ are obvious, since either 
a = \a\ or else a = — Similarly — 16| < b < \b\. Now four 
applications of 04 yield 

-\a\ + (-|6|) < a + 6 < |a| + 6 < |a| + |6| 

so that 

-(|a| + |6|) <a + 6< |a| + 

This tells us a + 6 < |a| + |6| and also —(a + 6) < |a| + \b\. 
Since |a + 6| is equal to either a + 6 or — (a + 6), we conclude 
|a + 6| < \a\ + \b\. ■ 

3.6 Corollary. 

dist(a, c) < dist(a, 6) + dist(6, c) /or a// a^b^c ^ R. 
Proof 

We can apply inequality (iii) of Theorem 3.5 to a — b and 6 — c to 
obtain |(a — 6) + (6 — c)| < \a — b\ + \b — c\ or dist(a,c) = |a — c| < 
|a — 6| + |6 — c| < dist(a, 6) + dist(6, c). ■ 

The inequality in Corollary 3.6 is very closely related to an 
inequality concerning points a, b, c in the plane, and the latter in- 
equality can be interpreted as a statement about triangles: the length 
of a side of a triangle is less than or equal to the sum of the lengths 
of the other two sides. See Fig. 3.2. For this reason, the inequality 
in Corollary 3.6 and its close relative (iii) in Theorem 3.5 are often 
called the Triangle Inequality. 

3.7 Triangle Inequality. 

|a + 6| < \a\ + \b\ for all a, b. 



A useful variant of the triangle inequality is given in Exer- 
cise 3.5(b). 
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Exercises 

3.1 (a) Which of the properties A1-A4, M1-M4, DL, 01-05 fail for N? 
(b) Which of these properties fail for Z? 

3.2 (a) The commutative law A2 was used in the proof of (ii) in 

Theorem 3.1. Where? 

(b) The commutative law A2 was also used in the proof of (iii) in 
Theorem 3.1. Where? 

3.3 Prove (iv) and (v) of Theorem 3.1. 

3.4 Prove (v) and (vii) of Theorem 3.2. 

3.5 (a) Show |6| < a if and only if —a < b < a. 
(b) Prove ||a| - |6|| < |a - b\ for all a, 6 G M. 

3.6 (a) Prove |a + 6 + c| < |a| + |6| + |c| for all a,6,c G M. ffint: Apply the 

triangle inequality twice. Do not consider eight cases. 

(b) Use induction to prove 

1^1 +a2 H httnl < |ai| + \a2\ H h \an\ 

for n numbers ai, a2, . . . , a^. 

3.7 (a) Show \b\ < a if and only if —a < b < a. 

(b) Show |a — 6| < c if and only ifb — c<a<b-\-c. 

(c) Show |a — 6| < c if and only ifb — c<a<b-\-c. 

3.8 Let a, 6 G M. Show if a < 6i for every bi > 6, then a < b. 
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§4 The Completeness Axiom 

In this section we give the completeness axiom for M. This is the 
axiom that will assure us R has no "gaps." It has far-reaching conse- 
quences and almost every significant result in this book relies on it. 
Most theorems in this book would be false if we restricted our world 
of numbers to the set Q of rational numbers. 

4.1 Definition. 

Let 5 be a nonempty subset of R. 

(a) If S contains a largest element sq [that is, sq belongs to S and 
s < So for all 5^5], then we call sq the maximum of S and 
write Sq — max S. 

(b) If S contains a smallest element, then we call the smallest 
element the minimum of S and write it as min S. 

Example 1 

(a) Every finite nonempty subset of R has a maximum and a 
minimum. Thus 

max{l, 2, 3, 4, 5} = 5 and min{l, 2, 3, 4, 5} = 1, 
max{0, TT, —7, e, 3, 4/3} = tt and min{0, tt, —7, e, 3, 4/3} = —7, 
max{n G Z : -4 < n < 100} = 100 and 
min{n G Z : -4 < n < 100} = -3. 

(b) Consider real numbers a and b where a < b. The following 
notation will be used throughout 

[a, 6] = G R : a < X < 6}, (a, 6) = {x G R : a < x < 6}, 
[a,b) = {x e R : a < X < b}, (a, 6] = {x G R : a < x < b}. 

[a, b] is called a closed interval^ (a, b) is called an open interval, 
while [a, b) and (a, b] are called half-open or semi-open intervals. 
Observe max[a,6] = b and min[a,6] = a. The set (a, 6) has no 
maximum and no minimum, since the endpoints a and b do not 
belong to the set. The set [a, 6) has no maximum, but a is its 
minimum. 

(c) The sets Z and Q have no maximum or minimum. The set N 
has no maximum, but minN = 1. 
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(d) The set {r e Q : 0 < r < \/2} has a minimum, namely 0, but 
no maximum. This is because \/2 does not belong to the set, 
but there are rationals in the set arbitrarily close to \/2- 

(e) Consider the set {n^~^'>'' : n G N}. This is shorthand for the 
set 

{1-1,2, 3-1,4, 5-1,6, 7-1, . . .} = {1, 2, |,4, i, 6, . . .}. 
The set has no maximum and no minimum. □ 

4.2 Definition. 

Let 5 be a nonempty subset of R. 

(a) If a real number M satisfies 5 < M for all 5 G 5, then M is 
called an upper bound of S and the set S is said to be bounded 
above. 

(b) If a real number m satisfies m < 5 for all 5 G 5, then m is 
called a lower bound of S and the set S is said to be bounded 
below. 

(c) The set S is said to be bounded if it is bounded above and 
bounded below. Thus S is bounded if there exist real numbers 
m and M such that S C [m, M]. 

Example 2 

(a) The maximum of a set is always an upper bound for the set. 
Likewise, the minimum of a set is always a lower bound for the 
set. 

(b) Consider a, 6 in R, a < b. The number b is an upper bound for 
each of the sets [a, 6], (a, 6), [a, 6), (a, 6]. Every number larger 
than b is also an upper bound for each of these sets, but b is 
the smallest or least upper bound. 

(c) None of the sets Z, Q and N is bounded above. The set N is 
bounded below; 1 is a lower bound for N and so is any number 
less than L In fact, 1 is the largest or greatest lower bound. 

(d) Any nonpositive real number is a lower bound for {r G Q : 
0 < r < \/2} and 0 is the set's greatest lower bound. The least 
upper bound is \/2. 

(e) The set {n^~^'>'' : n G N} is not bounded above. Among its 
many lower bounds, 0 is the greatest lower bound. □ 
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We now formalize two notions that have aheady appeared in 
Example 2. 

4.3 Definition. 

Let 5 be a nonempty subset of R. 

(a) If S is bounded above and S has a least upper bound, then we 
will call it the supremum of S and denote it by sup S. 

(b) If S is bounded below and S has a greatest lower bound, then 
we will call it the infimum of S and denote it by inf S. 

Note that, unlike max 5 and minS, sup 5 and inf 5 need not 
belong to S. Note also that a set can have at most one maximum, 
minimum, supremum and infimum. Sometimes the expressions "least 
upper bound" and "greatest lower bound" are used instead of the 
Latin "supremum" and "infimum" and sometimes sup 5 is written 
lub S and inf S is written gib S. We have chosen the Latin termi- 
nology for a good reason: We will be studying the notions "limsup" 
and "liminf" and this notation is completely standard; no one writes 
"lim lub" for instance. 

Observe that if S is bounded above, then M — sup S if and only 
if (i) s < M for all 5 G 5, and (ii) whenever Mi < M, there exists 
si ^ S such that si > Mi. 

Example 3 

(a) If a set S has a maximum, then max 5 = sup 5. A similar 
remark applies to sets that have infimums. 

(b) If a, 6 G R and a < 6, then 

sup[a, b] = sup(a, b) = sup[a, b) = sup(a, b] = b. 

(c) As noted in Example 2, we have inf N = L 

(d) If A = {r G Q : 0 < r < V^}, then supA = V2 and inf A = 0. 

(e) We have inf{n(-i)" : n G N} = 0. □ 

Example 4 

(a) The set A = : n G N and n > 3} is bounded above and 
bounded below. It has a maximum, namely ^, but it has no 
minimum. In fact, sup(A) = ^ and inf (A) = 0. 
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(b) The set B = {r G Q : < 7} is bounded above, by 2 for 
example. It does not have a maximum, because ^ 7 for ah 
r G Q, by the Rational Zeros Theorem 2.2. However, sup(S) = 
\/7. The set B is not bounded below; if this isn't obvious, think 
about the graph of ^ = x^. Clearly B has no minimum. Starting 
with the next section, we would write inf(B) = — oo. 

(c) The set C = {m + nV2 : m,n ^ isn't bounded above or 
below, so it has no maximum or minimum. We could write 
sup(C) = +00 and inf(C) — — oo. 

(d) The set D = {x e R : x'^ < 10} is the open interval 
(— VTO, VTO)- Thus it is bounded above and below, but it 
has no maximum or minimum. However, mi{D) — — \/lO and 
sup(L)) = vTO. □ 

Note that, in Examples 2-4, every set S that is bounded above 
possesses a least upper bound, i.e., sup 5 exists. This is not an acci- 
dent. Otherwise there would be a "gap" between the set S and the 
set of its upper bounds. 

4.4 Completeness Axiom. 

Every nonempty subset S ofR that is bounded above has a least upper 
bound. In other words, sup S exists and is a real number. 

The completeness axiom for Q would assert that every nonempty 
subset of Q, that is bounded above by some rational number, has a 
least upper bound that is a rational number. The set A = {r G Q : 
is a set of rational numbers and it is bounded above by 
some rational numbers [3/2 for example], but A has no least upper 
bound that is a rational number. Thus the completeness axiom does 
not hold for Q! Incidentally, the set A can be described entirely in 
terms of rationals: A = {r ^ Q : 0 < r and < 2}. 

The completeness axiom for sets bounded below comes free. 

4.5 Corollary. 

Every nonempty subset SofR that is bounded below has a greatest 
lower bound inf S. 
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Proof 

Let —S he the set {— s : s G 5}; — 5 consists of the negatives of the 
numbers in S. Since S is bounded below there is an m in R such 
that m < 5 for ah s ^ S. This imphes —m > —s for ah 5 G 5, 
so —m > u for ah u in the set —S. Thus —S is bounded above by 
— m. The Completeness Axiom 4.4 applies to —5, so sup(— 5) exists. 
Figure 4.1 suggests we prove inf S = — sup(— 5). 
Let 5o = sup(— 5); we need to prove 

— 5o < 5 for all 5 G 5, (1) 

and 

lit <s for ah 5 G 5, then t < -sq. (2) 

The inequality (1) will show —sq is a lower bound for 5, while (2) 
will show —Sq is the greatest lower bound, that is, — = inf S. We 
leave the proofs of (1) and (2) to Exercise 4.9. ■ 

It is useful to know: 

if a > 0, then — < a for some positive integer n, (*) 
n 

and 

if 6 > 0, then b < n for some positive integer n. (**) 

These assertions are not as obvious as they may appear. If fact, there 
exist ordered fields that do not have these properties. In other words, 
there exists a mathematical system satisfying all the properties Al- 
A4, M1-M4, DL and 01-05 in §3 and yet possessing elements a > 0 
and 6 > 0 such that a < 1/n and n < b for all n. On the other hand. 
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such strange elements cannot exist in R or Q. We next prove this; in 
view of the previous remarks we must expect to use the Completeness 
Axiom. 

4.6 Archimedean Property. 

If a > 0 and b > 0, then for some positive integer n, we have na > b. 

This tells us that, even if a is quite small and b is quite large, 
some integer multiple of a will exceed b. Or, to quote [4], given enough 
time, one can empty a large bathtub with a small spoon. [Note that 
if we set 6 = 1, we obtain assertion (*), and if we set a = 1, we 
obtain assertion (**).] 

Proof 

Assume the Archimedean property fails. Then there exist a > 0 and 
b > 0 such that na < b for all n G N. In particular, b is an upper 
bound for the set S = {na : n G N}. Let sq = sup S] this is where we 
are using the completeness axiom. Since a > 0, we have 5o < 5o + a, 
so 5o — a < 50- [To be precise, we obtain sq < sq + a and sq — a < sq 
by property 04 and the fact that a + (—a) = 0. Then we conclude 
5o — a < 5o since sq — a = sq implies a = 0 by Theorem 3.1(i).] Since 
So is the least upper bound for sq — a cannot be an upper bound 
for S. It follows that sq — a < n^a for some no G N. This implies 
So < {tlq + l)a. Since (no + l)a is in 5, sq is not an upper bound 
for S and we have reached a contradiction. Our assumption that the 
Archimedean property fails was wrong. ■ 

We give one more result that seems obvious from our experi- 
ence with the real number line, but which cannot be proved for an 
arbitrary ordered field. 

4.7 Denseness of Q. 

// a, 6 G R and a < b, then there is a rational r G Q such that 
a < r < b. 

Proof 

We need to show a < ^ < 6 for some integers m and n where n > 0, 
and thus we need 



an < m < bn. 



(1) 
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Since 6 — a > 0, the Archimedean property shows there exists an 
n G N such that 

n{b — a) > 1, and hence bn — an > 1. (2) 

From this, it is fairly evident that there is an integer m between an 
and 6n, so that (1) holds. However, the proof that such an m exists is 
a little delicate. We argue as follows. By the Archimedean property 
again, there exists an integer k > max{|an|, so that 

—k < an < bn < k. 

Then the sets K = {j e Z : —k < j < k} and {j e K : an < j} 
are finite, and they are nonempty, since they both contain k. Let 
m = min{j ^ K : an < j}. Then —k < an < m. Since m > —k, we 
have m — 1 in so the inequality an < m — 1 is false by our choice 
of m. Thus m — 1 < an and, using (2), we have m < an + 1 < bn. 
Since an < m < bn, (1) holds. ■ 



Exercises 

4.1 For each set below that is bounded above, list three upper bounds for 
the set.2 Otherwise write "NOT BOUNDED ABOVE" or "NBA." 



(a) [0,1] 


(b) 


(0,1) 




(c) {2,7} 

(e) : n e N} 


(d) 


{7r,e} 




(f) 


{0} 




(g) [0,1]U[2,3] 

(i) n-i[-i,i + i] 


(h) 


U~i[ 


2n, 2n + 1] 


(j) 




^ : n e N} 


(k) {n+ : n G N} 


(1) 


{r G i 


3 : r < 2} 


(m) {r G Q < 4} 


(n) 


{r G i 


2 : r2 < 2} 


(o) {x G M : a; < 0} 


(P) 




7r2,10} 
l-i,l+i 

n " n 


(q) {0,1,2,4,8,16} 

(s) {- : n G N and n is prime} 


(r) 


n~i( 


(t) 


{x G ] 




(u) {a;2 : a; G R} 


(v) 


{cos(- 


f):neN} 



(w) {sin(^) : n G N} 

4.2 Repeat Exercise 4.1 for lower bounds. 

4.3 For each set in Exercise 4.1, give its supremum if it has one. Otherwise 
write "NO sup." 



^An integer p > 2 is a prime provided the only positive factors of p are 1 and p. 
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4.4 Repeat Exercise 4.3 for infima [plural of infimum]. 

4.5 Let 5' be a nonempty subset of M that is bounded above. Prove if 
sups' belongs to 5, then sups' = maxS. Hint: Your proof should be 
very short. 

4.6 Let S be a nonempty bounded subset of M. 

(a) Prove inf S < supS. Hint: This is almost obvious; your proof 
should be short. 

(b) What can you say about S if inf S = sup SI 

4.7 Let S and T be nonempty bounded subsets of M. 

(a) Prove if S C T, then inf T < inf S < supS < supT. 

(b) Prove sup(5'UT) = maxjsup 5', supT}. Note: In part (b), do not 
assume 5' C T. 

4.8 Let S and T be nonempty subsets of R with the following property: 
s <t for all s e S and t eT. 

(a) Observe S is bounded above and T is bounded below. 

(b) Prove sup S < inf T. 

(c) Give an example of such sets S and T where S' H T is nonempty. 

(d) Give an example of sets S and T where sup S = inf T and S DT 
is the empty set. 

4.9 Complete the proof that inf S' = — sup(— 5') in Corollary 4.5 by 
proving (1) and (2). 

4.10 Prove that if a > 0, then there exists n G N such that ^ < a < n. 

4.11 Consider a, 6 G M where a < b. Use Denseness of Q 4.7 to show there 
are infinitely many rationals between a and b. 

4.12 Let I be the set of real numbers that are not rational; elements of I 
are called irrational numbers. Prove if a < 6, then there exists x el 
such that a < X <b. Hint: First show {r + \/2 : r G Q} C I. 

4.13 Prove the following are equivalent for real numbers a, 6, c. [Equivalent 
means that either all the properties hold or none of the properties 
hold.] 

(i) |a - 6| < c, 

(ii) b — c<a<b-\-c^ 
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(iii) a G (6 — c, 6 + c). 

Hint: Use Exercise 3.7(b). 

4.14 Let A and B be nonempty bounded subsets of M, and let A -\- B be 
the set of all sums a -\- b where a ^ A and b ^ B. 

(a) Prove su.p{A^B) = sup A+sup B. Hint: To show sup A+sup B < 
sup(A + 5), show that for each b e B, sup(74 + 5) — 6 is an 
upper bound for A, hence sup A < sup(A + 5) — 6. Then show 
sup(A + 5) — sup A is an upper bound for B. 

(b) Prove mf{A + 5) = inf A + inf B. 

4.15 Let a, 6 G M. Show if a < 6 + ^ for all n G N, then a < b. Compare 
Exercise 3.8. 

4.16 Show sup{r G Q : r < a} = a for each a G M. 



§5 The Symbols +00 and —00 

The symbols +00 and —00 are extremely useful even though they 
are not real numbers. We will often write +00 as simply 00. We will 
adjoin +00 and — oc to the set M and extend our ordering to the set 
RU {— (X),+(X)}. Explicitly, we will agree that — oc < a < +00 for 
all a in R U {—00, 00}. This provides the set R U {—00, +00} with an 
ordering that satisfies properties 01, 02 and 03 of §3. We emphasize 
we will not provide the set RU {—00, +00} with any algebraic struc- 
ture. We may use the symbols +oc and —00, but we must continue 
to remember they do not represent real numbers. Do not apply a 
theorem or exercise that is stated for real numbers to the symbols 
+00 or —00. 

It is convenient to use the symbols +oc and — oc to extend the 
notation established in Example 1(b) of §4 to unbounded intervals. 
For real numbers a, 6 G R, we adopt the following 

[a, 00) = {x G R : a < x}, (a, 00) = {x G R : a < x}, 
(-00, 6] = {x G R : X < 6}, (-00, 6) = {x G R : X < 6}. 

We occasionally also write (—00,00) for R. [a, 00) and (—00,6] are 
called closed intervals or unbounded closed intervals, while (a, 00) and 
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(—00,6) are called open intervals or unbounded open intervals. Con- 
sider a nonempty subset S of M. Recall that if S is bounded above, 
then sup S exists and represents a real number by the completeness 
axiom 4.4. We define 

sup 5 = +00 if 5 is not bounded above. 

Likewise, if S is bounded below, then inf S exists and represents a 
real number [Corollary 4.5]. And we define 

inf S = —00 if 5 is not bounded below. 

For emphasis, we recapitulate: 

Let S be any nonempty subset ofR. The symbols sup S and inf S 
always make sense. If S is bounded above, then sup S is a real num- 
ber; otherwise sup S = +00. If S is bounded below, then inf S is a real 
number; otherwise inf S = —00. Moreover, we have inf S < sup 5. 

Example 1 

For nonempty bounded subsets A and B of R, Exercise 4.14 asserts 

sup(A + 5) = supA + sup5 and inf (A + S) = inf A + inf (1) 

We verify the first equality is true even if A or 5 is unbounded, and 
Exercise 5.7 asks you to do the same for the second equality. 

Consider x G A + so that x = a + 6 for some a G A and b ^ B. 
Then x = a + 6 < sup A + sup B. Since x is any element in A + S, 
sup A + sup 5 is an upper bound for A + B; hence sup(A + B) < 
sup A + sup B. It remains to show sup(A + B) > sup A + sup B. 

Since the sets here are nonempty, the suprema here are not equal 
to —00, so we're not in danger of encountering the undefined sum 
— oc + oc. If sup A + sup B = +00, then at least one of the suprema, 
say supB, equals +00. Select some ao in A. Then sup(A + B) > 
sup(ao + S) = ao + supB = +oc, so (1) holds in this case. Otherwise 
sup A + supB is finite. Consider e > 0. Then there exists a e A and 
6 G so that a > sup A — ^ and b > sup B — ^. Then a + 6 G A + B 
and so sup(A + B) > a + b > sup A + supS — e. Since e > 0 is 
arbitrary, we conclude sup(A + B) > sup A + sup B. □ 

The exercises for this section clear up some loose ends. Most of 
them extend results in §4 to sets that are not necessarily bounded. 
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Exercises 

5.1 Write the following sets in interval notation: 

(a) {x G M : X < 0} (b) {x eR:x^ <S} 

(c) {x'^ :x e M} (d) {x eR'.x'^ <S} 

5.2 Give the infimum and supremum of each set listed in Exercise 5.1. 

5.3 Give the infimum and supremum of each unbounded set listed in 
Exercise 4.1. 

5.4 Let 5' be a nonempty subset of R, and let —S = {—s : s G S}. Prove 
inf S = — sup{—S). Hint: For the case — oc < inf simply state that 
this was proved in Exercise 4.9. 

5.5 Prove inf 6* < sup 5 for every nonempty subset of M. Compare 
Exercise 4.6(a). 

5.6 Let S and T be nonempty subsets of M such that 5' C T. Prove inf T < 
inf S < sups' < supT. Compare Exercise 4.7(a). 

5.7 Finish Example 1 by verifying the equality involving infimums. 



§6 * A Development of M 

There are several ways to give a careful development of R based on Q. 
We will briefly discuss one of them and give suggestions for further 
reading on this topic. [See the remarks about enrichment sections in 
the preface.] 

To motivate our development we begin by observing 

a = sup{r G Q : r < a} for each a G R; 

see Exercise 4.16. Note the intimate relationship: a < 6 if and only 
if {r G Q : r < a} C {r G Q : r < 6} and, moreover, a = 6 if and 
only if {r G Q : r < a} = {r G Q : r < 6}. Subsets a of Q having the 
form {r G Q : r < a} satisfy these properties: 

(i) a ^ Q and a is not empty, 
(ii) If r G a, 5 G Q and 5 < r, then 5 G a, 
(iii) a contains no largest rational. 
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Moreover, every subset « of Q that satisfies (i)-(iii) has the form 
{r G Q : r < a} for some a G M; in fact, a = sup«. Subsets a of Q 
satisfying (i)-(iii) are called Dedekind cuts. 

The remarks in the last paragraph relating real numbers and 
Dedekind cuts are based on our knowledge of R, including the com- 
pleteness axiom. But they can also motivate a development of R 
based solely on Q. In such a development we make no a priori as- 
sumptions about R. We assume only that we have the ordered field 
Q and that Q satisfies the Archimedean property 4.6. A Dedekind 
cut is a subset a of Q satisfying (i)-(iii). The set R of real numbers 
is defined as the space of all Dedekind cuts. Thus elements of R are 
defined as certain subsets of Q. The rational numbers are identified 
with certain Dedekind cuts in the natural way: each rational s cor- 
responds to the Dedekind cut 5* = {r G Q : r < s}. In this way 
Q is regarded as a subset of R, that is, Q is identified with the set 
Q* = {5* : 5 G Q}. 

The set R defined in the last paragraph is given an order structure 
as follows: if a and /3 are Dedekind cuts, then we define a < ^ to 
signify a C /3. Properties 01, 02 and 03 in §3 hold for this ordering. 
Addition is defined in R as follows: if a and /3 are Dedekind cuts, 
then 

a + /3 = {ri + r2 : ri G « and r2 G 

It turns out that a + ^5 is a Dedekind cut [hence in R] and this defi- 
nition of addition satisfies properties A1-A4 in §3. Multiplication of 
Dedekind cuts is a tedious business and has to be defined first for 
Dedekind cuts >0*. For a naive attempt, see Exercise 6.4. After the 
product of Dedekind cuts has been defined, the remaining proper- 
ties of an ordered field can be verified for R. The ordered field R 
constructed in this manner from Q is complete: the completeness 
property in 4.4 can be proved rather than taken as an axiom. 

The real numbers are developed from Cauchy sequences in Q 
in [31, §5]. A thorough development of R based on Peano's axioms 
is given in [39]. 
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Exercises 

6.1 Consider s^t G Q. Show 

(a) s <t if and only if s* C t*; 

(b) s = t if and only if s* =t*; 

(c) (5 + t)* = s* + r. Note that 5* + T is a sum of Dedekind cuts. 

6.2 Show that if a and /3 are Dedekind cuts, then so is a + /3 = {ri + r2 : 
ri G ce and r2 G 

6.3 (a) Show ce + 0* = a for all Dedekind cuts a. 

(b) We claimed, without proof, that addition of Dedekind cuts satis- 
fies property A4. Thus if ce is a Dedekind cut, there is a Dedekind 
cut —a such that a + (— ce) = 0*. How would you define —a? 

6.4 Let a and /3 be Dedekind cuts and define the "product": a-^ = {rir2 : 
ri e a and r2 G 

(a) Calculate some "products" of Dedekind cuts using the Dedekind 
cuts 0*, 1* and (-1)*. 

(b) Discuss why this definition of "product" is totally unsatisfactory 
for defining multiplication in R. 

6.5 (a) Show {r G Q : < 2} is a Dedekind cut, but {r G Q : < 2} is 

not a Dedekind cut. 

(b) Does the Dedekind cut {r G Q : < 2} correspond to a rational 
number in M? 

(c) Show 0* U {r G Q : r > 0 and < 2} is a Dedekind cut. Does it 
correspond to a rational number in R? 
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CHAPTER 



Sequences 



§7 Limits of Sequences 

A sequence is a function whose domain is a set of the form {n G Z : 
n > m}; m is usually 1 or 0. Thus a sequence is a function that 
has a specified value for each integer n > m. It is customary to de- 
note a sequence by a letter such as s and to denote its value at n 
as Sn rather than s{n). It is often convenient to write the sequence 
as {sn)n=m i^m^ 5^+1, 5^+2, . . H Tu = 1 wc may write {Sn)neN 
or of course (51,52,53, . . .). Sometimes we will write (5^) when the 
domain is understood or when the results under discussion do not 
depend on the specific value of m. In this chapter, we will be inter- 
ested in sequences whose range values are real numbers, i.e., each 5^ 
represents a real number. 

Example 1 

(a) Consider the sequence {sn)neN where 5^ = This is the 
sequence (1, |, ^, ^, ^, . . .). Formally, of course, this is the 
function with domain N whose value at each n is \. The set 
of values is {1, |, ^, ^, ^, . . .}. 
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(b) Consider the sequence given by = ( — 1)^ for n > 0, i.e., 
(a^)^Q where = (—1)^. Note that the first term of the se- 
quence is ao = 1 and the sequence is (1,-1,1,— 1,1,— 1,1,...). 
Formahy, this is a function whose domain is {0,1,2,...} and 
whose set of values is { — 1,1}. 

It is important to distinguish between a sequence and its 
set of values, since the validity of many results in this book 
depends on whether we are working with a sequence or a set. 
We will always use parentheses ( ) to signify a sequence and 
braces { } to signify a set. The sequence given by = (— 1)^ 
has an infinite number of terms even though their values are 
repeated over and over. On the other hand, the set {(—1)^ : 
n = 0,1,2,...} is exactly the set { — 1,1} consisting of two 
numbers. 

(c) Consider the sequence cos(^), n G N. The first term of this 
sequence is cos(|) = cos 60° = ^ and the sequence looks like 

V2' 2' 2'2'-^'2' 2' 2'2'-^'2' 2' ^^••'J' 

The set of values is {cos(^) : n G N} = {^,-^,-1,1}. 

(d) If an = \/^, n G N, the sequence is (1, \/2, v^, v^, • • •)• If 
approximate values to four decimal places, the sequence looks 
like 

(1, 1.4142, 1.4422, 1.4142, 1.3797, 1.3480, 1.3205, 1.2968, . . .). 

It turns out that aioo is approximately 1.0471 and ai^ooo is 
approximately 1.0069. 

(e) Consider the sequence 6^ = (1 + ^)^, n G N. This is the se- 
quence (2, (|)^, (1)^5 • • •)• If approximate the values to 
four decimal places, we obtain 

(2, 2.25, 2.3704, 2.4414, 2.4883, 2.5216, 2.5465, 2.5658, . . .). 

Also 6ioo is approximately 2.7048 and 6i,ooo is approximately 
2.7169. ' □ 

The "limit" of a sequence (5^) is a real number that the values 
Sn are close to for large values of n. For instance, the values of the 
sequence in Example 1(a) are close to 0 for large n and the values 
of the sequence in Example 1(d) appear to be close to 1 for large n. 
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The sequence (a^) given by = (—1)^ requires some thought. We 
might say 1 is a hmit because in fact — 1 for the large values of n 
that are even. On the other hand, = — 1 [which is quite a distance 
from 1] for other large values of n. We need a precise definition in 
order to decide whether 1 is a limit of — (—1)^. It turns out that 
our definition will require the values to be close to the limit value 
for all large n, so 1 will not be a limit of the sequence = (—1)^. 

7.1 Definition. 

A sequence (5^) of real numbers is said to converge to the real number 
s provided that 

for each e > 0 there exists a number such that 

n > N implies — 5| < e. (1) 

If (sji) converges to 5, we will write lim^^oo <§n = or s. The 

number s is called the limit of the sequence (5^). A sequence that 
does not converge to some real number is said to diverge. 

Several comments are in order. First, in view of the Archimedean 
property, the number A^ in Definition 7.1 can be taken to be a positive 
integer if we wish. Second, the symbol e [lower case Greek epsilon] 
in this definition represents a positive number, not some new exotic 
number. However, it is traditional in mathematics to use e and 6 
[lower case Greek delta] in situations where the interesting or chal- 
lenging values are the small positive values. Third, condition (1) is 
an infinite number of statements, one for each positive value of e. 
The condition states that to each e > 0 there corresponds a number 
A^ with a certain property, namely n > N implies — s| < e. The 
value A^ depends on the value e, and normally A^ will have to be 
large if e is small. We illustrate these remarks in the next example. 

Example 2 

3+ — 

Consider the sequence Sn = 7^-4 - If we write Sn as ^ and note 

n 

- and - are very small for large n, it seems reasonable to conclude 
lims^ = y. In fact, this reasoning will be completely valid after we 
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have the hmit theorems in S9: 



hm Sn = hm 



3+i 

n 

7-^ 



hm3 + hm(^) 3 + 0 



hm7-4hm(^) 7-4-0 



However, for now we are interested in analyzing exactly what we 
mean by lims^ = |. By Definition 7.1, lims^ = | means 



for each e > 0 there exists a number such that 



n > N implies 



3n+l 



7n-4 



< e. 



(1) 



As e varies, varies. In Example 2 of the next section we will show 
that, for this particular sequence, N can be taken to be 



19 

49e 



+ 



Using this observation, we find that for e equal to 1, 0.1, 0.01, 0.001, 
and 0.000001, respectively, N can be taken to be approximately 0.96, 
4.45, 39.35, 388.33, and 387,755.67, respectively. Since we are inter- 
ested only in integer values of n, we may as well drop the fractional 
part of N. Then we see five of the infinitely many statements given 
by (1) are: 



n > 0 implies 

n > 4 implies 

n > 39 implies 

11 > 388 implies 

n > 387,755 implies 



3n + 1 3 
~ 7 
3 

7n-4 7 
3n + 1 3 



7n-4 
3n + 1 



7n-4 7 
3n + 1 3 
7 
3 



7n-4 
3n + 1 



7n-4 7 



<i; 

< 0.1; 

< 0.01; 

< 0.001; 

< 0.000001. 



(2) 
(3) 
(4) 
(5) 
(6) 



Table 7.1 partially confirms assertions (2) through (6). We could go 
on and on with these numerical illustrations, but it should be clear 
we need a more theoretical approach if we are going to prove results 
about limits. □ 



Example 3 

We return to the examples in Example 1. 
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TABLE 7.1 



n 


3n+l 
~ 7n-4 

IS approximately 


1 o 3 1 

IS approximately 


2 


0.7000 


0.2714 


3 


0.5882 


0.1597 


4 


0.5417 


0.1131 


5 


0.5161 


0.0876 


6 


0.5000 


0.0714 


40 


0.4384 


0.0098 


400 


0.4295 


0.0010 



(a) lim ^ = 0. This will be proved in Example 1 of the next 
section. 

(b) The sequence (a^) where = (—1)^ does not converge. Thus 
the expression "lima^" is meaningless in this case. We will 
discuss this example again in Example 4 of the next section. 

(c) The sequence cos(^) does not converge. See Exercise 8.7. 

(d) The sequence n^/^ appears to converge to 1. We will prove 
limn^/^ = 1 in Theorem 9.7(c) on page 48. 

(e) The sequence (6^) where bn = (1 + ^)^ converges to the number 
e that should be familiar from calculus. The limit lim 6^ and 
the number e will be discussed further in Example 6 in §16 and 
in §37. Recall e is approximately 2.7182818. □ 

We conclude this section by showing that limits are unique. That 
is, if lim 5^ = s and lim 5^ = t, then we must have 5 = t. In short, 
the values cannot be getting arbitrarily close to different values 
for large n. To prove this, consider e > 0. By the definition of limit 
there exists A^i so that 

n > Ni implies \sn — 5| < - 
and there exists N2 so that 

n > N2 implies — t| < -. 
For n > max{A^i, N2}^ the Triangle Inequality 3.7 shows 

\s-t\ = \{S - Sn) + {Sn t)\ < \s - Sn\ + \Sn - t\ < ^ + ^ = 6. 
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This shows |5 — t| < e for all e > 0. It follows that \s — t\ = 0; hence 
s = t. 



Exercises 

7.1 Write out the first five terms of the following sequences, 
(a) Sn = ^, (b) &„ = 

(c) c„ = ^ (d) Mf) 

7.2 For each sequence in Exercise 7.1, determine whether it converges. If 
it converges, give its hmit. No proofs are required. 

7.3 For each sequence below, determine whether it converges and, if it 
converges, give its hmit. No proofs are required. 



(a) a„ = ^ (b) b, 

(c) Cn = 2-" (d) t„ = 1 + f 

(e) a;„ = 73 +(-!)» (f) = (2)^/" 

(g) y„=n! (h) d„ = (-l)"n 

(i) ^ (J) &i 

(k) 1^ (1) sin(^) 

(m) sin(n7r) (n) sin(2^) 

(o) ssinn (p) 

(q) (r) (1 + 

4n^+3 /^\ 6n+4 



7.4 Give examples of 

(a) A sequence {xn) of irrational numbers having a limit limx^ 
that is a rational number. 

(b) A sequence (r^) of rational numbers having a limit limr^ that 
is an irrational number. 

7.5 Determine the following limits. No proofs are required, but show any 
relevant algebra. 

(a) lim Sn where Sn = + 1 — ^, 



(b) lim(\/^^ + n — n), 



(c) lim(\/4n2 + n - 2n). 

ffin^ /or (a): First show Sn ~ ^ 
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§8 A Discussion about Proofs 

In this section we give several examples of proofs using the definition 
of the limit of a sequence. With a little study and practice, students 
should be able to do proofs of this sort themselves. We will some- 
times refer to a proof as a formal proof to emphasize it is a rigorous 
mathematical proof. 



Example 1 

Prove lim A- = 0. 

Discussion. Our task is to consider an arbitrary e > 0 and show 
there exists a number [which will depend on e] such that n > N 
implies |^ — 0| < e. So we expect our formal proof to begin with 
"Let e > 0" and to end with something like "Hence n > N implies 
1^ — 0| < e." In between the proof should specify an N and then 
verify has the desired property, namely n > N does indeed imply 

l^-o|<^- 

As is often the case with trigonometric identities, we will initially 
work backward from our desired conclusion, but in the formal proof 
we will have to be sure our steps are reversible. In the present exam- 
ple, we want |^ — 0| < e and we want to know how big n must be. 
So we will operate on this inequality algebraically and try to "solve" 
for n. Thus we want ^ < e. By multiplying both sides by and 
dividing both sides by e, we find we want ^ < or < n. If our 
steps are reversible, we see n > implies |^ — 0| < e. This suggests 
we put N = 



Formal Proof 

Let e > 0. Let N = Then n > N implies n > which implies 

> ^ and hence e > Thus n > N implies |^ — 0| < e. This 

proves lim ^ = 0. ■ 



Example 2 

Prove limf^ = f. 



2. Sequences 



Discussion. For each e > 0, we need to to decide how big n must 
be to guarantee — f | < Thus we want 



21n + 7-21n + 12 



7(4n - 4) 





19 


< e or 


7(7n - 4) 



< e. 



Since 7n — 4 > 0, we can drop the absolute value and manipulate 
the inequality further to "solve" for n: 



19 
7e 



< 7n — 4 or 



19 
7e 



+ 4 < 7n or 



19 4 
49^+7<"- 



Our steps are reversible, so we will put N = ^ + |- Incidentally, we 
could have chosen to be any number larger than ^ + |- 



Formal Proof 

Let e > 0 and let = ^ + f Then n > N implies ^ > ^ + 



hence 7n > ^ + 4, hence 7n — 4 > 
If^ - f I < 6. This proves lim 



19 
7e ' 



hence 

3 
7' 



19 

7(7n-4) 



< e, and hence 



Example 3 

Prove lim = 4. 

Discussion. For each e > 0, we need to determine how large n 
has to be to imply 



4n^ + 3n 



< e 



or 



3n + 24 



< e. 



By considering n > 1, we may drop the absolute values; thus we need 
to find how big n must be to give ^^z^ < This time it would be 
very difficult to "solve" for or isolate n. Recall we need to find some 



such that n > N implies 



3n+24 



< e, but we do not need to find 



the least such N. So we will simplify matters by making estimates. 
The idea is that is bounded by some constant times ^ = ^ 

for sufficiently large n. To find such a bound we will find an upper 
bound for the numerator and a lower bound for the denominator. 



27n 



< e. 



For example, since 3n + 24 < 27n, it suffices for us to get 
To make the denominator smaller and yet a constant multiple of n^, 
we note — G > \ provided n is sufficiently large; in fact, all we 
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need 



is ^ > 6 or > 12 or n > 2. So it suffices to get < e or 

2 — — ^ n-^/z 



54 



< e or n > 



provided n > 2. 



Formal Proof 

Let e > 0 and let = max{2, ^J~^}^ Then n> N implies n > ^J~^, 

hence ^ < e, hence < e. Since n > 2, we have ^ < — 6 and 
also 27n > 3n + 24. Thus n> N implies 



3n + 24 27n 



54 



and hence 



as desired. 



4n^ + 3n 



6 



-4 



Example 3 illustrates direct proofs of even rather simple limits 
can get complicated. With the limit theorems of §9 we would just 
write 



lim 



4n^ + 3n 



lim 



1- A 



lim 4 + 3 • lim(^ j 



lim 1 — 6 • lim(^ 



4. 



Example 4 

Show that the sequence = ( — 1)^ does not converge. 

Discussion. We will assume lim(— 1)^ = a and obtain a contra- 
diction. No matter what a is, either 1 or —1 will have distance at 
least 1 from a. Thus the inequality |(— 1)^ — a\ < 1 will not hold for 
all large n. 



Formal Proof 

Assume lim( — 1)^ = a for some a G M. Letting e = 1 in the definition 
of the limit, we see that there exists N such that 

n>N implies |(-l)'^-a|<L 

By considering both an even and an odd n > we see that 

11 — a| < 1 and I — 1 — a| < L 
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Now by the Triangle Inequality 3.7 

2 = |l-(-l)| = |l-a + a-(-l)| < |l-a| + |a-(-l)| < 1 + 1 = 2. 

This absurdity shows our assumption lim(— 1)^ = a must be wrong, 
so the sequence (—1)^ does not converge. ■ 

Example 5 

Let (sn) be a sequence of nonnegative real numbers and suppose 
s = limsn- Note 5 > 0; see Exercise 8.9(a). Prove lim -y/s^ = y/s. 

Discussion. We need to consider e > 0 and show there exists N 
such that 

n > N implies ~ V^l < ^• 

This time we cannot expect to obtain explicitly in terms of e 
because of the general nature of the problem. But we can hope to 
show such exists. The trick here is to violate our training in algebra 
and "irrationalize the denominator" : 



Since 5^ ^ 5 we will be able to make the numerator small [for large 
n]. Unfortunately, if 5 = 0 the denominator will also be small. So we 
consider two cases. If 5 > 0, the denominator is bounded below by 
y/s and our trick will work: 



so we will select N so that — 5| < ^/se for n > N. Note that N 
exists, since we can apply the definition of limit to y/~se just as well 
as to e. For 5 = 0, it can be shown directly that lim 5^ = 0 implies 
lim ^/s^ = 0; the trick of "irrationalizing the denominator" is not 
needed in this case. 

Formal Proof 

Case I: 5 > 0. Let e > 0. Since lim 5^ = 5, there exists N such that 
n > N implies — 5| < yGe. 
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Now n > N implies 



Case II: s = 0. This case is left to Exercise 8.3 



s\ \/se 
— < = e. 



Example 6 

Let (sn) be a convergent sequence of real numbers such that 5^ ^ 0 
for all n G N and lims^ = 5^0. Prove inf{|5^| : n G N} > 0. 

Discussion. The idea is that "most" of the terms Sn are close to s 
and hence not close to 0. More explicitly, "most" of the terms Sn are 
within ^1^1 of 5, hence most Sn satisfy > This seems clear 
from Fig. 8.1, but a formal proof will use the triangle inequality. 



Formal Proof 

Let e = l\s\ > 0. Since lims^ = 5, there exists in N so that 



n > N implies \sn — s\ < 



Now 



n > N implies > — , 

since otherwise the triangle inequality would imply 

I I — I 1^1 I I I 1"^! 1"^! 

\s\ — \s Sfi -\- Sji\ ^ \s Sji\ + I^T^I <^ ~^ \ ~ 
which is absurd. If we set 



(1) 



most5„ here 
A 



r>0 



mosts„ here 



-s<0 



FIGURE 8.1 
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then we clearly have m > 0 and > m for a// n G N in view of (1). 
Thus inf{|5^| : n G N} > m > 0, as desired. ■ 

Formal proofs are required in the following exercises. 



Exercises 

8.1 Prove the following: 



(a) lim = 0 (b) lim ^ = 0 

(c) ^^M = l (d)lim-^=0 



1/3 

_ _ 1 + 6 

3n+2 3 ^^^^^ n2-6 

8.2 Determine the limits of the following sequences, and then prove your 



claims. 

7n-19 
3n+7 



(a) an = ^ (b) bn = 

\^) ~ 7n-5 "'^ ~ 5n+2 

(e) Sn = ^sinn 

8.3 Let {sn) be a sequence of nonnegative real numbers, and suppose 
limsn = 0. Prove \miy/s^ = 0. This will complete the proof for 
Example 5. 

8.4 Let {tn) be a bounded sequence, i.e., there exists M such that \tn\ < M 
for all n, and let (sn) be a sequence such that lims^ = 0. Prove 
lim(5ntn) 0. 

8.5 

(a) Consider three sequences (a^), {bn) and (sn) such that < 
Sn ^ bn for all n and lima^ = lim^^ = s. Prove lims^ = s. 
This is called the "squeeze lemma." 

(b) Suppose (sn) and {tn) are sequences such that \sn\ ^ tn for all 
n and limt^ = 0. Prove lims^ = 0. 

8.6 Let {sn) be a sequence in R. 

(a) Prove lims^ = 0 if and only if lim \ sn\ = 0. 

(b) Observe that if 5^ = (—1)^, then lim \ sn \ exists, but lims^ does 
not exist. 



8.7 Show the following sequences do not converge, 
(a) cos(if ) (b) s„ = (-1)' 

(c) sin(2f ) 



n 



^This exercise is referred to in several places. 
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8.8 Prove the fohowing [see Exercise 7.5]: 

(a) hm[\/^^ + 1 — n] = 0 (b) hm[\/ + n — n] = ^ 

(c) hm[\/4n2 + n -2n] = \ 

8.9 Let {sn) be a sequence that converges. 

(a) Show that if 5^ > « for ah but finitely many n, then lim 5^ > 

(b) Show that if 5^ < ^ for all but finitely many n, then lims^ < h. 

(c) Conclude that if all but finitely many Sn belong to [a, 6], then 
limsn belongs to [a, 6]. 

8.10 Let {sn) be a convergent sequence, and suppose lims^ > d- Prove 
there exists a number TV such that n > N implies Sn > a. 

§9 Limit Theorems for Sequences 

In this section we prove some basic results that are probably al- 
ready familiar to the reader. First we prove convergent sequences 
are bounded. A sequence (sn) of real numbers is said to be bounded 
if the set {sn : n G N} is a bounded set, i.e., if there exists a constant 
M such that < M for all n. 

9.1 Theorem. 

Convergent sequences are bounded. 
Proof 

Let (sji) be a convergent sequence, and let s = lim 5^. Applying 
Definition 7.1 with e = 1 we obtain in N so that 

n > N implies \sn — 5| < 1. 

From the triangle inequality we see n > N implies < |s| + 1. 
Define M = max{|5| + 1, |52|, . . . , l^ivl}. Then we have < M 
for all n G N, so (sn) is a bounded sequence. ■ 

In the proof of Theorem 9.1 we only needed to use property 7.1(1) 
for a single value of e. Our choice of e = 1 was quite arbitrary. 



^This exercise is referred to in several places. 
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9.2 Theorem. 

// the sequence (sn) converges to s and k is in then the sequence 
(ksji) converges to ks. That is, lim(fcs^) = k • lims^. 

Proof 

We assume k ^ 0, since this result is trivial for A; = 0. Let e > 0 and 
note we need to show \ksn — ks\ < e for large n. Since lims^ = 5, 
there exists such that 

n > N implies \sn — s\ < —-. 

\k\ 

Then 

n > N implies \ksn — ks\ < e. ^ 

9.3 Theorem. 

If (sn) converges to s and (tn) converges to t, then (sn+tn) converges 
to 8 + t. That is, 

lim(5^ + tn) = lim Sn + lim tn- 

Proof 

Let e > 0; we need to show 

|<Sn + — (5 + I < e for large n. 

We note \sn + tn — {s + t)\ < \sn — s\ + \tn—t\. Since lim Sn = 5, there 
exists Ni such that 

n > Ni implies \sn — s\ < ^. 

Likewise, there exists N2 such that 

n > N2 implies \tn — t\ < -. 

Let N = max{A^i, A^2}. Then clearly 

n>N implies \sn+tn — {s+t)\ < + 1|<^ + ^ = e. ^ 

9.4 Theorem. 

If (sn) converges to s and (tn) converges to t, then (sntn) converges 
to st. That is, 

lim(5^t^) = (lim 5^) (lim t^). 
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Discussion. The trick here is to look at the inequahty 

l^ntn "^^1 — l^ntn ~\~ Sjit st\ 

— l^ntfi ^nt\ ~\~ \Sfit st\ — I^T^I * \tfi ^1 ~l~ 1^1 ' "^|* 

For large n, 1| and — 5| are small and |t| is, of course, constant. 
Fortunately, Theorem 9.1 shows is bounded, so we will be able 
to show \sntn — Snt\ is Small. 

Proof 

Let e > 0. By Theorem 9.1 there is a constant M > 0 such that 
l^nl < M for all n. Since limt^ = t there exists A^i such that 

e 



n > Ni implies \tn —t\ < 



2M' 



Also, since lims^ = s there exists A^2 such that 



n > N2 implies 



s\ < 



2(|t| + l)- 

[We used 2(\t\+i) instead of because t could be 0.] Now if = 
max{A^i, ^"2}, then n > N implies 



<M-5jg + |t| 



e e e 

2{\t\ + l) ^ 2 + 2 " 



To handle quotients of sequences, we first deal with reciprocals. 
9.5 Lemma. 

If (sji) converges to s, if Sn 0 for all n, and if s 0, then (l/sn) 
converges to 1/s. 

Discussion. We begin by considering the equality 



1 1 




S Sfi 


Sfi s 




SjiS 



For large n, the numerator is small. The only possible difficulty would 
be if the denominator were also small for large n. This difficulty was 
solved in Example 6 of §8 where we proved m=inf{|5^| : nGN}>0. 
Thus 

1 1 



< 



m\s\ 
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and it is clear how our proof should proceed. 



Proof 

Let e > 0. By Example 6 of §8, there exists m > 0 such that > m 
for all n. Since lim Sn = s there exists N such that 

n > N implies \s — Sn\ < e • m\s\. 

Then n > N implies 

1 1 



S Sri \ \ S S ri \ 

^ < J < e. 



\SnS\ m\s\ 



9.6 Theorem. 

Suppose (sn) converges to s and (tn) converges to t. If s 0 and 
Sn ¥^ 0 for all n, then (tn/sn) converges to t/s. 

Proof 

By Lemma 9.5, the sequence {1/sn) converges to so 

tn I 1 t 

lim — = lim — • tn = - • t = - 

Sn Sn S S 

by Theorem 9.4. ■ 

The preceding limit theorems and a few standard examples allow 
one to easily calculate many limits. 

9.7 Theorem (Basic Examples). 

(a) lim^^oo(^) = 0 for p > 0. 

(b) lim^^oo = 0 if \a\ < 1. 

(c) lim(nV^) = 1. 

(d) lim^^oo(a^/'') = 1 for a > 0. □ 
Proof 

(a) Let e > 0 and let N = (^)Vp. Then n > N implies > ^ 

1^1 ^ 
and hence e > Since ^ > 0, this shows n > N implies 

1^ — 0| < e. [The meaning of when p is not an integer will 

be discussed in §37.] 

(b) We may suppose a ^ 0, because lim^^oo = 0 is obvious for 
a = 0. Since \a\ < 1, we can write \a\ = where 6 > 0. By 
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the binomial theorem [Exercise 1.12], (1 + 6)^ > 1 + nb > nb, 
so 

|a^-0| = |a^| = < \. 

' ' ' ' (1 + 6)^ n6 

Now consider e > 0 and let = ^ . Then n > N implies n > ^ 
and hence — 0| < ^ < e. 

(c) Let 5^ = (n-^/^) — 1 and note 5^ > 0 for all n. By Theorem 9.3 
it suffices to show lims^ = 0. Since 1 + Sn = (n^^^), we have 
n = (1 + 5^)^. For n > 2 we use the binomial expansion of 
(1 + 5^)^ to conclude 

n={l + SnT >l + nsn + ^n{n - 1)4 > ^ri{n - 1)4- 

Thus n > — 1)5^, so 5^ < Consequently, we have 

5^ < ^J~^i for n > 2. A standard argument now shows 
lims^ = 0; see Exercise 9.7. 

(d) First suppose a > 1. Then for n > a we have 1 < o}/^ < n}/^ . 
Since Ximii}/^ = 1, it follows easily that lim(a-'^/^) = 1; compare 
Exercise 8.5(a). Suppose 0 < a < 1. Then ^ > 1, so lim(^)^/'^ = 
1 from above. Lemma 9.5 now shows lim(a^/^) = 1. ■ 



Example 1 

Prove lim — \^ where 



_ + Gn^ + 7 



Solution 

We have 



1 + ^ + ^ 

n n-^ 

'--4 + 4-4' 

By Theorem 9.7(a) we have lim ^ = 0 and lim ^ = 0. Hence by 
Theorems 9.3 and 9.2 we have 

lim I 1 + - + ^ ) = lim(l) + 6 • lim ( - ) + 7 • lim ( ^ ) = 1. 



2. Sequences 



Similarly, we have 



lim ( 4 + 4j - ^ 1 = 4. 



Hence Theorem 9.6 implies lims^ ~ \' ^ 
Example 2 

Findlim^. □ 



Solution 

Let Sn = - 
does not converge. So we write 



^ 1-- 
Let Sn = We can write Sn as — ^, but then the denominator 



1 + ^. 



2 



Now lim(^ - = 0 by Theorems 9.7(a), 9.3 and 9.2. Likewise 

lim(l + ^) — 1, so Theorem 9.6 implies lims^ ~ J ~ ^- '-' 

Example 3 

Findlim^. □ 



Solution 



We can write as 



2 



f T 1 



Both fractions lead to problems: either the numerator does not con- 
verge or else the denominator converges to 0. It turns out '^^^^ does 

not converge and the symbol lim ^^^i is undefined, at least for the 
present; see Example 6. The reader may have the urge to use the sym- 
bol +00 here. Our next task is to make such use of the symbol +00 
legitimate. For a sequence (5^), lim 5^ = +00 will signify that the 
terms Sn are eventually all large. Here is the precise definition. □ 



9.8 Definition. 

For a sequence (5^), we write lim 5^ = +00 provided 
for each M > 0 there is a number N such that 
n > N implies Sn > M. 
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In this case we say the sequence diverges to +00. 
Similarly, we write lims^ = —00 provided 
for each M < 0 there is a number N such that 
n > N implies Sn < M. 

Henceforth we will say (5^) has a limit or the limit exists pro- 
vided (sji) converges or diverges to +00 or diverges to —00. In the 
definition of lim = +00 the challenging values of M are large pos- 
itive numbers: the larger M is the larger N will need to be. In the 
definition of lims^ = — oc the challenging values of M are "large" 
negative numbers like -10,000,000,000. 

Example 4 

We have limn^ = +00, lim(— n) = —00, lim 2^ = +00 and 
lim(^^ + 7) = +00. Of course, many sequences do not have limits 
+00 or —00 even if they are unbounded. For example, the sequences 
defined by Sn = ( — l)^n and t^ = ncos^(^) are unbounded, but 
they do not diverge to +00 or — oc, so the expressions lim[(— l)^n] 
and lim[n cos^(^)] are meaningless. Note t^ = n when n is even and 
tn — ^ when n is odd. □ 

The strategy for proofs involving infinite limits is very much the 
same as for finite limits. We give some examples. 

Example 5 

Give a formal proof that \im{^/n + 7) = +00. □ 

Discussion. We need to consider an arbitrary M > 0 and show 
there exists [which will depend on M] such that 

n> N imphes ^/n + ^ > M. 

To see how big must be we "solve" for n in the inequality ^/rl+7 > 
M. This inequality holds provided ^Jn > M - 7 or n > (M - 7)^. 
Thus we will take N={M-7f. 

Formal Proof 

Let M > 0 and let = {M-lf. Then n > implies n > (M-7)^ 
hence ^/n > M — 7, hence + 7 > M. This shows lim{y/ri + 7) = 
+00. ■ 
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Example 6 

n+1 



Give a formal proof that lim = +00; see Example 3. □ 



Discussion. Consider M > 0. We need to determine how large n 
must be to guarantee > M . The idea is to bound the fraction 

^^^i below by some multiple of ^ = n; compare Example 3 of §8. 
Since + 3 > and n + 1 < 2n, we have ^^^^ ^ ^ ~ 
suffices to arrange for > M. 

Formal Proof 

Let M > 0 and let N 2M. Then n> N imphes \n> M, which 
implies 

71^ + 3 1 

> — = -n > M. 

n + 1 2n 2 

Hence lim +00. ■ 

The limit in Example 6 would be easier to handle if we could 
apply a limit theorem. But the limit Theorems 9.2-9.6 do not apply. 

WARNING. Do not attempt to apply the limit Theorems 9.2-9.6 
to infinite limits. Use Theorem 9.9 or 9.10 below or Exercises 9.9- 
9.12. 



9.9 Theorem. 

Let {sji) and (tn) be sequences such that lim 5^ = +00 and limt^ > 0 
[limt^ can be finite or +00]. Then lim Sntn — +00. 

Discussion. Let M > 0. We need to show Sntn > M for large n. 
We have lim = +00, and we need to be sure the t^'s are bounded 
away from 0 for large n. We will choose a real number m so that 
0 < m < limt^ and observe tn > m for large n. Then all we need is 
Sn> ^ for large n. 

Proof 

Let M > 0. Select a real number m so that 0 < m < limt^. Whether 
limtn = +00 or not, it is clear there exists A^i such that 

n > Ni implies t^ > m] 
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see Exercise 8.10. Since lims^ = +00, there exists N2 so that 

n> JM2 imphes Sn> — • 

m 

Put N = max{A^i, A^2}. Then n > imphes Sntn > ^'m = M. ■ 
Example 7 

Use Theorem 9.9 to prove lim ^ = +00; see Example 6. □ 
Solution ^ 

We observe = = Sntn where 5^ = n + | and tn = It 
is easy to show hms^ = +00 and limtn = 1. So by Theorem 9.9, we 
have hm Sntn — +00. □ 

Here is another useful theorem. 

9.10 Theorem. 

For a sequence (sn) of positive real numbers, we have lim 5^ = +00 
if and only z/lim(^) = 0. 

Proof 

Let (sn) be a sequence of positive real numbers. We have to show 
lim 5^ = +00 implies lim ( — ) = 0 (1) 



and 



lim ( — 1=0 implies lim 5^ = +oc. (2) 



In this case the proofs will appear very similar, but the thought 
processes will be quite different. 

To prove (1), suppose lim 5^ = +oc. Let e > 0 and let M = ^. 
Since lim 5^ = +00, there exists such that n > N implies Sn > 
M = -. Therefore n > N implies e > — > 0, so 



n > N implies 



i-o 



< e. 



That is, lim(^) = 0. This proves (1). 

To prove (2), we abandon the notation of the last paragraph and 
begin anew. Suppose lim(^) = 0. Let M > 0 and let e = -p^. Then 
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e > 0, SO there exists N such that n > N imphes — 0\ < e = j^. 
Since 5^ > 0, we can write 

n > N imphes 0 < — < 

Sn M 

and hence 

n > N imphes M < Sn- 
That is, hms^ = +00 and (2) holds. ■ 



Exercises 

9.1 Using the Hmit Theorems 9.2-9.7, prove the fohowing. Justify ah steps. 
(a)lim^=l (b)limM = i 

17n^+73n^-18n^+3 _ 17 
^^"^ 23n5+13n3 ~ 23 

9.2 Suppose \imxn = 3, \imyn = 7 and ah yn are nonzero. Determine the 
fohowing limits: 

(a) lim{xn + Vn) (b) lim 

9.3 Suppose limttn = a, lim6n = 6, and Sn = ^^rr^- Prove lims^ = 

3 ri^r 

carefully, using the limit theorems. 

9.4 Let 5i = 1 and for n > 1 let s^+i = V^n + 1- 

(a) List the first four terms of (sn)- 

(b) It turns out that {sn) converges. Assume this fact and prove 
the limit is ^(1 + \/5). 

9.5 Let ti = 1 and t^+i = for n > 1. Assume (tn) converges and find 
the limit. 

9.6 Let xi = 1 and x^+i = 3x^ for n > 1. 

(a) Show if a = limx^, then a = | or a = 0. 

(b) Does \imxn exist? Explain. 

(c) Discuss the apparent contradiction between parts (a) and (b). 

9.7 Complete the proof of Theorem 9.7(c), i.e., give the standard argument 
needed to show lims^ = 0. 
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9.8 Give the following when they exist. Otherwise assert "NOT EXIST." 

(a) limn^ (b) lim(— n^) 
(c) lim(-n)^ (d) lim(l.Ol)^ 
(e) limn^ 

9.9 Suppose there exists Nq such that Sn < tn for all n > Nq. 

(a) Prove that if limsn = +oc, then limt^ = +00. 

(b) Prove that if \im tn = — oc, then limsn = — 00. 

(c) Prove that if limsn and \imtn exist, then limsn < limt^. 

9.10 (a) Show that if limsn = +00 and /c > 0, then lim(/c5n) = +oc. 

(b) Show limsn = +oc if and only if lim(— 5^) = —00. 

(c) Show that if limsn = +oc and /c < 0, then lim(/c5n) = —00. 

9.11 (a) Show that if limsn = +00 and mf{tn : n G N} > — oc, then 

lim(5n + tn) +00. 

(b) Show that if limsn = +oc and \imtn > — oc, then lim(5n + tn) = 

+ OC. 

(c) Show that if lim Sn = +oc and if {tn) is a bounded sequence, then 

lim(5n + tn) +00. 

9.12 Assume all 5^ 7^ 0 and that the limit L = lim exists. 

(a) Show that if L < 1, then limsn = 0. Hint: Select a so that 
L < a < 1 and obtain TV so that |5n+i| < ci\sn\ for n > N. 
Then show \sn\ < a^-^|5Ar| for n> N. 

(b) Show that if L > 1, then lim|5n| = +oc. Hint: Apply (a) to 
the sequence tn = see Theorem 9.10. 



9.13 Show 

lim a"^ 



0 if \a\ < 1 

1 if a = 1 
+0C if a > 1 
does not exist if a < —1. 



9.14 Let p > 0. Use Exercise 9.12 to show 

[ 0 if |a|<l 

lim — = < +0C if a > 1 

^ y does not exist if a < —1. 

Hint: For the a > 1 case, use Exercise 9.12(b). 



^This exercise is referred to in several places. 
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9.15 Show limn^cx) ^ = 0 for all a G M. 

9.16 Use Theorems 9.9 and 9.10 or Exercises 9.9-9.15 to prove the following: 

(a) lim^ 

(b) \im[^ + (-1)"] = +^ 

(c) lim[^ - |1] = +^ 

9.17 Give a formal proof that limn^ = +oc using only Definition 9.8. 

9.18 (a) Verify 1 + a + + • • • + = ^^^^ for a ^ 1. 

(b) Find limn^cx)(l + a + H h a'') for \a\ < 1. 

(c) Calculate limn^cx)(l + i + ^ + ^^)- 

(d) What is limn^cx)(l + a + H h a^) for a > 1? 



§10 Monotone Sequences and Cauchy 
Sequences 

In this section we obtain two theorems [Theorems 10.2 and 10.11] 
that will allow us to conclude certain sequences converge without 
knowing the limit in advance. These theorems are important because 
in practice the limits are not usually known in advance. 

10.1 Definition. 

A sequence (sn) of real numbers is called an increasing sequence 
if Sn < Sn+i for all n, and (sn) is called a decreasing sequence if 
Sn ^ Sji+i for all n. Note that if (sn) is increasing, then Sn < Sm 
whenever n < m. A sequence that is increasing or decreasing^ will 
be called a monotone sequence or a monotonic sequence. 

Example 1 

The sequences defined by = 1 — ^, 6^ = and = 
(1 + ^)^ are increasing sequences, although this is not obvious for the 



^In the First Edition of this book, increasing and decreasing sequences were 
referred to as "nondecreasing" and "nonincreasing" sequences, respectively. 
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sequence (c^). The sequence = ^ is decreasing. The sequences 

Sn (-1)'', tn cos(^), Un = (-l)''n and Vn = are not 

monotonic sequences. Also Xn = n^/^ is not monotonic, as can be 
seen by examining the first four values; see Example 1(d) on page 33 
in §7. 

Of the sequences above, (a^), (c^), (d^), (5^), (t^), (vn) and (x^) 
are bounded sequences. The remaining sequences, (6^) and (un), are 
unbounded sequences. □ 

10.2 Theorem. 

All bounded monotone sequences converge. 
Proof 

Let (sn) be a bounded increasing sequence. Let S denote the set 
{sn : n G N}, and let u = sup 5. Since S is bounded, u represents a 
real number. We show lims^ = u. Let e > 0. Since u — e is not an 
upper bound for 5, there exists N such that sn > u — e. Since (5^) 
is increasing, we have sn < for all n > A^. Of course, < u for 
all so n > N implies u — e < Sn < which implies \sn — u\ < e. 
This shows lims^ — ix. 

The proof for bounded decreasing sequences is left to 
Exercise 10.2. ■ 

Note the Completeness Axiom 4.4 is a vital ingredient in the 
proof of Theorem 10.2. 

Example 2 

Consider the sequence (5^) defined recursively by 

+5 

5i = 5 and Sn = for n > 2. (1) 

25^-1 

Thus 52 = 3 and 2.333. First, note a simple induction 

argument shows 5^ > 0 for all n. We will show lim^ exists by 
showing the sequence is decreasing and bounded; see Theorem 10.2. 
In fact, we will prove the following by induction: 

<Sn<5 for n > 1. (2) 
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i^mce x/5 ^ 2.236, our computations show (2) holds for n < 2. For 
the induction step, assume (2) holds for some n > 2. To show 5^+2 < 
5^+1, we need 



25, 



n+1 



< 5^+1 or 5^+1 + 5 < 25^+1 or 5 < 5^+1, 



but this holds because 5^+1 > \/5 by the assumption (2) for n. To 
show 5^+2 > x/S, we need 

^""^^ ^ ^ > or 5^+1 + 5 > 2^55^+1 



25^+1 

or 5^^]^— 2\/55^+i+5 > 0, which is true because 5^^^^— 2\/55^+i+5 = 
(5^+1 — \/5)^ > 0. Thus (2) holds for n + 1 whenever (2) holds for n. 
Hence (2) holds for all n by induction. Thus 5 = lim^ 5^ exists. 

If one looks at 54 = |y ^ 2.238095 and compares with \/5 ^ 
2.236068, one might suspect 5 = \/5. To verify this, we apply the 
limit Theorems 9.2-9.4 and the fact 5 = lim^ 5^+1 to the equation 
2 • Sn^iSn = 5^ + 5 to obtain 2s'^ = 5^ + 5. Thus = 5 and 5 = \/5, 
since the limit is certainly not □ 

10.3 Discussion of Decimals. 

We have not given much attention to the notion that real numbers 
are simply decimal expansions. This notion is substantially correct, 
but there are subtleties to be faced. For example, different decimal 
expansions can represent the same real number. The somewhat more 
abstract developments of the set R of real numbers discussed in §6 
turn out to be more satisfactory. 

We restrict our attention to nonnegative decimal expansions and 
nonnegative real numbers. From our point of view, every nonnegative 
decimal expansion is shorthand for the limit of a bounded increasing 
sequence of real numbers. Suppose we are given a decimal expansion 
K.did2dsd4 • • •, where K is a nonnegative integer and each dj belongs 
to {0,1,2,3,4,5,6,7,8,9}. Let 

Srn = K ^ ^ + ---H . 1) 

10 102 10^ ^ ^ 

Then (5^) is an increasing sequence of real numbers, and (5^) is 
bounded [by K + 1, in fact]. So by Theorem 10.2, (5^) converges to 
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a real number we traditionally write as K.did2dsd4 • • •. For example, 
3.3333 • • • represents 

1. 3 3 3 \ 

hm 3 H \ ^ H \ . 

n^oc \ 10 102 10^ J 

To calculate this limit, we borrow the following fact about geometric 
series from Example 1 on page 96 in §14: 

lima(l +r + r^H ^ r"") = for |r| < 1; (2) 

see also Exercise 9.18. In our case, a = 3 and r = ^, so 3.3333 • • • 
represents \ = ^, as expected. Similarly, 0.9999 • • • represents 

hm \ ^ \ = = 1. 

n^oo^lO 102 10^ y 1-^ 

Thus 0.9999 • • • and 1.0000 • • • are different decimal expansions that 
represent the same real number! 

The converse of the preceding discussion also holds. That is, every 
nonnegative real number x has at least one decimal expansion. This 
will be proved, along with some related results, in §16. □ 

Unbounded monotone sequences also have limits. 

10.4 Theorem. 

(i) // (sji) is an unbounded increasing sequence, then lims^ = 
+00. 

(ii) // (sn) is an unbounded decreasing sequence, then lim Sfi — 
— oc. 

Proof 

(i) Let (sn) be an unbounded increasing sequence. Let M > 0. 
Since the set {sn : n G N} is unbounded and it is bounded 
below by 5i, it must be unbounded above. Hence for some N 
in N we have sn > M. Clearly n > N implies Sn > sn > M, 
so lim Sn = +00. 

(ii) The proof is similar and is left to Exercise 10.5. ■ 
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10.5 Corollary. 

If (sn) is a monotone sequence, then the sequence either converges, 
diverges to +00^ or diverges to —00. Thus lim Sn is always meaningful 
for monotone sequences. 

Proof 

Apply Theorems 10.2 and 10.4. ■ 

Let (sn) be a bounded sequence in R; it may or may not converge. 
It is apparent from the definition of hmit in 7.1 that the hmiting 
behavior of (5^) depends only on sets of the form {sn : n > N}. For 
example, if lim 5^ exists, clearly it lies in the interval [un^vn] where 

UN = inf{5^ : n > N} and vn = supjs^ : n > N}; 

see Exercise 8.9. As N increases, the sets {sn : n > N} get smaller, 
so we have 

'^1 ^ '^2 ^ '^3 ^ • • • and '^1 > '^2 ^ '^3 ^ • • • ; 

see Exercise 4.7(a). By Theorem 10.2 the limits u = Huin^ooUn 
and V = limjv^oo vn both exist, and u < v since un < vn foi all N . 
If lim 5^ exists then, as noted above, un < lim 5^ < vn for all A^, 
so we must have u < lim 5^ < v. The numbers u and v are useful 
whether lim Sn exists or not and are denoted lim inf Sn and lim sup 5^, 
respectively. 

10.6 Definition. 

Let (sn) be a sequence in R. We define 

lim sup 5^= lim sup {5^ : n > A^} (1) 

and 

lim inf Sn = lim inf {sn : n > N}. (2) 

Note that in this definition we do not restrict (5^) to be bounded. 
However, we adopt the following conventions. If (s^) is not bounded 
above, supjs^ : n > N} = +00 for all A" and we decree lim sup = 
+00. Likewise, if (5^) is not bounded below, infjs^ : n > N} = —00 
for all A^ and we decree lim inf 5„ = — oc. 
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We emphasize limsups^ need not equal supjs^ : n G N}, but 
limsups^ < sup{5^ : n G N}. Some of the values Sn may be much 
larger than limsups^; limsups^ is the largest value that infinitely 
many s^s can get close to. Similar remarks apply to liminf Sn- These 
remarks will be clarified in Theorem 11.8 and §12, where we will give 
a thorough treatment of liminf 's and lim sup's. For now, we need 
a theorem that shows (5^) has a limit if and only if liminf 5^ = 
lim sup Sji- 

10.7 Theorem. 

Let (sn) be a sequence in R. 

(i) // lim 5^ is defined [as a real number, +00 or —00], then 
lim inf Sn = lim = lim sup 5^. 

(ii) //liminf 5^ = lim sup 5^ ^ then lim 5^ is defined and lim 5^ = 
lim inf Sn = lim sup 5^. 

Proof 

We use the notation un = infjs^ : n > N}^ vn = sup{s^ : n > N}, 
u — limi^Tv = liminf and v = limv^ = lim sup 5^. 

(i) Suppose lim = +00. Let M be a positive real number. Then 
there is a positive integer so that 

n> N implies Sn > M. 

Then i/at = infjs^ : n > A^} > M. It follows that m > N 
implies Um > M. In other words, the sequence (un) satisfies 
the condition defining limi^Tv = +c>o, i.e., liminf 5^ = +00. 
Likewise lim sup Sn — +00. 

The case lim — — cxd is handled in a similar manner. 

Now suppose lim 5^ = 5 where 5 is a real number. Consider 
e > 0. There exists a positive integer such that — 5| < e 
for n > N. Thus 5^ < 5 + e for n > A^, so 

vn = sup{5^ : n > N} < 5 + e. 

Also, m > N implies Vjn ^ s + e^ so lim sup 5^ — limvjn < 5 + e. 
Since lim sup 5^ < 5 + e for all e > 0, no matter how small, we 
conclude lim sup 5^ < = lim 5^. A similar argument shows 
lim 5^ < lim inf 5^. Since lim inf 5^ < lim sup 5^, we infer all 
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three numbers are equal: 

lim inf = lim Sn = lim sup 5^. 

(ii) If lim inf 5^ = lim sup 5^ = +00 it is easy to show lim 5^ = 
+00. And if lim inf Sn — lim sup 5^ — —00 it is easy to show 
lim 5^ = —00. We leave these two special cases to the reader. 

Suppose, finally, that lim inf = lim sup Sn = s where s is 
a real number. We need to prove lim 5^ = s. Let e > 0. Since 
s — limvN there exists a positive integer A^o such that 

\s — sup{5^ : n > No}\ < e. 

Thus sup{5^ : n > Nq} < 5 + e, so 

Sn < s + e for all n > Nq. (1) 

Similarly, there exists A^i such that \s — inf {5^ : n > A^i}! < e, 
hence inf {5^ : n > A^i} > 5 — e, hence 

Sn> s - e for all n > Ni. (2) 

From (1) and (2) we conclude 

s — e<Sn<s + e for n > maxjA'o? A^i}? 

equivalently 

\sn — s\ < e for n > maxjA^o, A^i}- 
This proves lim 5^ = 5 as desired. ■ 

If (sn) converges, then lim inf Sn = lim sup 5^ by the theorem just 
proved, so for large A^ the numbers supjs^ : n > N} and inf {5^ : 
n > N} are close together. This implies that all the numbers in the 
set {sji : n > N} are close to each other. This leads us to a concept of 
great theoretical importance that will be used throughout the book. 

10.8 Definition. 

A sequence (5^) of real numbers is called a Cauchy sequence if 

for each e > 0 there exists a number A^ such that 

m^n > N implies \sn — < 6. (1) 



Compare this definition with Definition 7.1. 
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10.9 Lemma. 

Convergent sequences are Cauchy sequences. 
Proof 

Suppose limsn = s. The idea is that, since the terms are close to 
s for large n, they also must be close to each other; indeed 

To be precise, let e > 0. Then there exists N such that 

n > N implies \sn — 5| < -. 
Clearly we may also write 

m > N implies \sm ~ s\ < 

so 

m^n > N implies 1^^ — < \sn — s\ + \s — Sm\ < ^ + ^ = ^• 
Thus (sn) is a Cauchy sequence. ■ 

10.10 Lemma. 

Cauchy sequences are bounded. 

Proof 

The proof is similar to that of Theorem 9.1. Applying Definition 10.8 
with e = 1 we obtain in N so that 

m,n > N implies \sn — Sm\ < 1- 

In particular, \sn — sn^i\ < 1 for n > A^, so < |57v+i| + 1 for 
n > A^. If M = max{|57v+i| + 1, |52|, . . . , I^atI}, then < M 
for ah n eN. ■ 

The next theorem is very important because it shows that to 
verify that a sequence converges it suffices to check it is a Cauchy 
sequence, a property that does not involve the limit itself. 

10.11 Theorem. 

A sequence is a convergent sequence if and only if it is a Cauchy 
sequence. 
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Proof 

The expression "if and only if" indicates that we have two assertions 
to verify: (i) convergent sequences are Cauchy sequences, and (ii) 
Cauchy sequences are convergent sequences. We aheady verified (i) 
in Lemma 10.9. To check (ii), consider a Cauchy sequence (sn) and 
note (sn) is bounded by Lemma 10.10. By Theorem 10.7 we need 
only show 

lim inf = lim sup s^- (1) 

Let e > 0. Since (5^) is a Cauchy sequence, there exists N so that 

m^n > N implies — < e. 

In particular, 5^ < 5^ + e for all m, n > A^. This shows 5^ + e is an 
upper bound for {sn : n > N}^ so vn = supjs^ : n > N} < 5^ + e 
for m > N. This, in turn, shows vn — e is a, lower bound for {5^ : 
m > N}^ so vn — e < mf{sm - m > N} — u^. Thus 

lim sup Sn < vn < UN + e < lim inf Sn + e. 

Since this holds for all e > 0, we have lim sup 5^ < lim inf 5^. The 
opposite inequality always holds, so we have established (1). ■ 

The proof of Theorem 10.11 uses Theorem 10.7, and Theo- 
rem 10.7 relies implicitly on the Completeness Axiom 4.4, since 
without the completeness axiom it is not clear that lim inf Sn and 
lim sup 5^ are meaningful. The completeness axiom assures us that 
the expressions supjs^ : n > N} and inf {5^ : n > N} in Defini- 
tion 10.6 are meaningful, and Theorem 10.2 [which itself relies on 
the completeness axiom] assures us that the limits in Definition 10.6 
also are meaningful. 

Exercises on lim sup's and lim inf 's appear in §§11 and 12. 



Exercises 

10.1 Which of the following sequences are increasing? decreasing? bounded? 

(a) i (b) 

(c) (d) sin(if ) 

(e) (-2)" (f) ^ 



Exercises 

10.2 Prove Theorem 10.2 for bounded decreasing sequences. 

10.3 For a decimal expansion K.did2dsd4 • • •, let (sn) be defined as in 
Discussion 10.3. Prove 5^ < + 1 for all n G N. Hint: ^ + i§2 + 
^ if^ = 1 - 1^ for all n. 

10.4 Discuss why Theorems 10.2 and 10.11 would fail if we restricted our 
world of numbers to the set Q of rational numbers. 

10.5 Prove Theorem 10.4(ii). 

10.6 (a) Let {sn) be a sequence such that 

kn+i - Sn\ < 2""" for all n G N. 

Prove {sn) is a Cauchy sequence and hence a convergent 
sequence. 

(b) Is the result in (a) true if we only assume \sn-\-i — 5^1 < ^ for all 

n G N? 

10.7 Let 5' be a bounded nonempty subset of M such that sup 5' is not in S. 
Prove there is a sequence {sn) of points in 5' such that lim Sn = sup S. 
See also Exercise 11.11. 

10.8 Let {sn) be an increasing sequence of positive numbers and define 
(Tn = ^(si + 52 H Sn)' Provc ((7^) is an increasing sequence. 

10.9 Let 5i = 1 and s^+i = for n > 1. 

(a) Find 52, 53 and 54. 

(b) Show lim Sn exists. 

(c) Prove limsn = 0. 

10.10 Let 5i = 1 and 5^+1 = ^{sn + 1) for n > 1. 

(a) Find S2, 53 and 54. 

(b) Use induction to show Sn > ^ for all n. 

(c) Show {sn) is a decreasing sequence. 

(d) Show limsn exists and find limsn- 

10.11 Let ti = l and t^+i = [1 - 4^] • for n > 1. 

(a) Show lim tn exists. 

(b) What do you think Hm tn is? 
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10.12 Let ti = 1 and t^+i = [1 ~ (n+iy ] ' n > 1. 

(a) Show \imtn exists. 

(b) What do you think Hm tn is? 

(c) Use induction to show tn = 

(d) Repeat part (b). 

§ 1 1 Subsequences 

11.1 Definition. 

Suppose {sn)neN is a sequence. A subsequence of this sequence is a 
sequence of the form {tk)keN where for each k there is a positive 
integer rik such that 

ni < n2 < - - • < rik < rik+i < • • • (1) 

and 

tk = Snk. (2) 

Thus (tk) is just a selection of some [possibly all] of the s^s taken 
in order. 

Here are some alternative ways to approach this concept. Note 
that (1) defines an infinite subset of N, namely {ni, n2, 713, . . .}. Con- 
versely, every infinite subset of N can be described by (1). Thus a 
subsequence of (5^) is a sequence obtained by selecting, in order, an 
infinite subset of the terms. 

For a more precise definition, recall we can view the sequence 
{sn)neN as a function s with domain N; see §7. For the subset 
{ni, 77.2, n3, . . .}, there is a natural function a [lower case Greek sigma] 
given by a{k) = for /c G N. The function a "selects" an infinite 
subset of N, in order. The subsequence of s corresponding to a is 
simply the composite function t = s o a. That is, 

tk = t{k) = 50 a{k) — s{a{k)) — s{nk) = for A; G N. (3) 

Thus a sequence t is a subsequence of a sequence s if and only if 
t = s o a for some increasing function a mapping N into N. We will 
usually suppress the notation a and often suppress the notation t 
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also. Thus the phrase "a subsequence (5^^) of (5^)" will refer to the 
subsequence defined by (1) and (2) or by (3), depending upon your 
point of view. 

Example 1 

Let (sji) be the sequence defined by Sn = 1)^. The positive terms 
of this sequence comprise a subsequence. In this case, the sequence 

{Sn) is 

(-1,4, -9, 16, -25, 36, -49, 64, . . .) 

and the subsequence is 

(4,16,36,64,100,144,...). 

More precisely, the subsequence is {snj^)keN where nk=2k so 
that 5^^ = (2A;)^(— 1)^^=4A:^. The selection function a is given by 

cr(/c) = 2/c. □ 

Example 2 

Consider the sequence = sin(^) and its subsequence (a^^) of 
nonnegative terms. The sequence {an)neN is 

i^Vs, ^VS, 0, -^VS, -^%/3, 0, ^^/3, ^%/3, 0, -^Vs, -^V3,0, . . .) 
and the desired subsequence is 

(^^/3,^^/3,0,0,^^/3,^^/3,0,0,...). 

It is evident that ni — 1^ n2 = 2, 713 = 3, 714 = 6, = 7, ne = 8, 
717 = 9, 7i8 = 12, 7i9 = 13, etc. We won't need a formula for rik^ 
but here is one: rik = ^ + 2[|j for /c > 1, where \_x\ is the "floor 
function," i.e., \_x\ is the largest integer less than or equal to x, for 
X G M. □ 

After some reflection, the next theorem will seem obvious, but 
it is good to have a complete proof that covers all situations. The 
proof is a little bit complicated, but we will apply the theorem several 
times rather than having to recreate a similar proof several times. ^ 
Thus it is important to understand the proof. 



^In the first edition of this book, we did create similar proofs instead. 
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11.2 Theorem. 

Let (sji) be a sequence. 

(i) Ift is in then there is a subsequence of (sn) converging to t 
if and only if the set {n G N : \sn — t\ < e} is infinite for all 
e > 0. 

(ii) // the sequence (sn) is unbounded above, it has a subsequence 
with limit +00. 

(iii) Similarly, if (5^) is unbounded below, a subsequence has limit 
—00. 

In each case, the subsequence can be taken to be monotonic.^ 
Proof 

The forward implications =4> in (i)-(iii) are all easy to check. For 
example, if lim^^ s^^ = t and e > 0, then all but finitely many of the 
rikS are in {n G N : — 1| < e}. We focus on the other implications, 
(i) First suppose the set {n G N : 5^ = t} is infinite. Then 
there are subsequences {snf^)keN such that = t for all 
k. Such subsequences of (5^) are boring monotonic sequences 
converging to t. 

Henceforth, we assume {n G N : 5^ = is finite. Then 

{n G N : 0 < — t| < e} is infinite for all e > 0. 

Since these sets equal 

{n eN : t - e < Sn <t}U {n eN : t < Sn <t ^ e}, 

and these sets get smaller as e ^ 0, we have 

{n e N : t - e < Sn < t} is infinite for ah e > 0, (1) 

or 

{n e N : t < Sn < t + e} is infinite for all e > 0; (2) 

otherwise, for sufficiently small e > 0, the sets in both (1) 
and (2) would be finite. 

We assume (1) holds, and leave the case that (2) holds 
to the reader. We will show how to define or construct 



This will be proved easily here, but is also a consequence of the more general 
Theorem 11.4. 
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step-by-step a subsequence {snj^)keN satisfying t — 1 < Sm < t 
and 

max|5^^_^,t - ^1 < < t for k>2. (3) 

Specifically, we will assume ni, n2, . . . , rik-i have been selected 
satisfying (3) and show how to select rik- This will give us an 
infinite increasing sequence {nk)keN aiid hence a subsequence 
(5^ J of (sn) satisfying (3). Since we will have < 
for all A;, this subsequence will be monotonically increasing. 
Since (3) also will imply t — | < < t for all A;, we will have 
liuik Sjif^ = t; compare Exercise 8.5(a) on page 44. 

A construction like the one described above, and executed 
below, is called an "inductive definition" or "definition by in- 
duction," even though the validity of the process is not a direct 
consequence of Peano's axiom N5 in §1.^ 

Here is the construction. Select ni so that t — 1 < Sm < 
t; this is possible by (1). Suppose ni,n2, . . . ,nk-i have been 
selected so that 



ni < 712 < • • • < rik-i (4) 



and 



max|5^^_^,t - j| < s^^. < t for j = 2, . . . , A; - 1. (5) 

Using (1) with e = max{5^^_^ , t — |}, we can select > n^-i 
satisfying (5) for j = A;, so that (3) holds for k. The procedure 
defines the sequence {nk)keN' This completes the proof of (i), 
and is the crux of the full proof, 
(ii) Let ni = 1, say. Given ni < • • • < rik-i^ select rik so that 
Snj^ > max{5^^_-^. A;}. This is possible, since (5^) is unbounded 
above. The sequence so obtained will be monotonic and have 
limit +00. A similar proof verifies (iii). ■ 



^Recursive definitions of sequences, which first appear in Exercises 9.4-9.6, can 
be viewed as simple examples of definitions by induction. 
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Example 3 

It can be shown that the set Q of rational numbers can be hsted 
as a sequence (r^), though it is tedious to specify an exact formula. 
Figure 11.1 suggests such a listing [with repetitions] where ri = 0, 
^2 = 1, ^3 = ^5 ^4 = ^5 = —1, ^6 = —2, rr = —1, etc. Readers 
familiar with some set theory will recognize this assertion as "Q 
is countable." This sequence has an amazing property: given any 
real number a there exists a subsequence (r^^) of (r^) converging to 
a. Since there are infinitely many rational numbers in every interval 
(a — e, a+e) by Exercise 4.11, Theorem 11.2 shows that a subsequence 
of (rji) converges to a. □ 

Example 4 

Suppose (sji) is a sequence of positive numbers such that infjs^ : 
n G N} = 0. The sequence (sn) need not converge or even be 
bounded, but it has a subsequence converging monotonically to 0. By 
Theorem 11.2, it suffices to show {n G N : 5^ < e} is infinite for each 
e > 0. Otherwise, this set would be finite for some eo > 0. If the set 
is nonempty, then infjs^ : n G N} = minjs^ : Sn < eo} > 0, because 
each Sn is positive and the set {sn : < eo} is finite. This contra- 
dicts our assumption infjs^ : n G N} = 0. If the set is empty, then 
inf{5^ : n G N} > eo > 0, again contrary to our assumption. □ 

The next theorem is almost obvious. 
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11.3 Theorem. 

// the sequence (5^) converges, then every subsequence converges to 
the same limit. 

Proof 

Let {sjij.) denote a subsequence of (5^). Note that Uk > k for all k. 
This is easy to prove by induction; in fact, ni > 1 and rik-i > k — 1 
implies Uk > rik-i > k — 1 and hence Uk > k. 

Let s = lim Sn and let e > 0. There exists so that n > N 
implies — 5| < e. Now k > N implies Uk > N, which implies 
l^rik - s\ < e. Thus 

lim Snj^ = s. 

Our immediate goal is to prove the Bolzano- Weierstrass theorem 
which asserts that every bounded sequence has a convergent sub- 
sequence. First we prove a theorem about monotonic subsequences. 

11.4 Theorem. 

Every sequence (sn) has a monotonic subsequence. 
Proof 

Let's say that the n-th term is dominant if it is greater than every 
term which follows it: 

Sm < Sn for all m > n. (1) 

Case 1. Suppose there are infinitely many dominant terms, and 
let (snj.) be any subsequence consisting solely of dominant terms. 
Then 5^^^^ < for all k by (1), so (5^^) is a decreasing sequence. 

Case 2. Suppose there are only finitely many dominant terms. Se- 
lect ni so that Sm is beyond all the dominant terms of the sequence. 
Then 

given N > ni there exists m > N such that 5^ > s^y. (2) 

Applying (2) with = Til we select TI2 ^ tii such that 57^2 ^ "^ni • 
Suppose ni, 712, . . . , ^it-i have been selected so that 



ni < 712 < • • • < rik-i 



(3) 
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and 

Applying (2) with = rik-i we select > Uk-i such that > 
^uk-i - Then (3) and (4) hold with k in place of /c — 1, the procedure 
continues by induction, and we obtain an increasing subsequence 

The elegant proof of Theorem 11.4 was brought to our attention 
by David M. Bloom and is based on a solution in D. J. Newman's 
beautiful book [48]. 

11.5 Bolzano- Weierstrass Theorem. 

Every hounded sequence has a convergent subsequence. 

Proof 

If {sji) is a bounded sequence, it has a monotonic subsequence by 
Theorem 11.4, which converges by Theorem 10.2. ■ 

The Bolzano- Weierstrass theorem is very important and will be 
used at critical points in Chap. 3. Our proof, based on Theorem 11.4, 
is somewhat nonstandard for reasons we now discuss. Many of the 
notions introduced in this chapter make equally good sense in more 
general settings. For example, the ideas of convergent sequence, 
Cauchy sequence and bounded sequence all make sense for a se- 
quence {sn) where each belongs to the plane. But the idea of 
a monotonic sequence does not carry over. It turns out that the 
Bolzano- Weierstrass theorem also holds in the plane and in many 
other settings [see Theorem 13.5], but clearly it would no longer be 
possible to prove it directly from an analogue of Theorem 11.4. Since 
the Bolzano- Weierstrass Theorem 11.5 generalizes to settings where 
Theorem 11.4 makes little sense, in applications we will emphasize 
the Bolzano- Weierstrass Theorem 11.5 rather than Theorem 11.4. 

We need one more notion, and then we will be able to tie our 
various concepts together in Theorem 11.8. 

11.6 Definition. 

Let {sn) be a sequence in R. A subsequential limit is any real number 
or symbol +00 or —00 that is the limit of some subsequence of (5^). 
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When a sequence has a hmit 5, then ah subsequences have hmit 
5, so {s} is the set of subsequential hmits. The interesting case is 
when the original sequence does not have a hmit. We return to some 
of the examples discussed after Definition 11.1. 

Example 5 

Consider (sn) where Sn = 1)^. The subsequence of even terms 
diverges to +00, and the subsequence of odd terms diverges to —00. 
All subsequences that have a limit diverge to +00 or —00, so that 
{—00, +00} is exactly the set of subsequential limits of (5^). □ 

Example 6 

Consider the sequence = sin(^) in Example 2. This sequence 
takes each of the values ^\/3, 0 and — ^\/3 an infinite number of 
times. The only convergent subsequences are constant from some 
term on, and { — 1\/3, 0, ^\/3} is the set of subsequential limits of 
(a^). If rik = 3A;, then a^^ = 0 for all A; G N and obviously 
liuik^^anj^ = 0. li rik = 6A; + 1, then a^^ = ^\/3 for all k and 
liuik^ooO^nk = ^\/3- And if Uk = 6k + 4, then lim^^oo Q^nfc = 

-^Vs. □ 

Example 7 

Let (r^) be a list of all rational numbers. It was shown in Example 3 
that every real number is a subsequential limit of (r^). Also, +00 
and —00 are subsequential limits; see Exercise 11.7. Consequently, 
R U {—00, +00} is the set of subsequential limits of (r^). □ 

Example 8 

Let bn = n[l + (—1)^] for n G N. Then bn — 2n for even n and 6^ = 0 
for odd n. Thus the 2-element set {0, +00} is the set of subsequential 
limits of (6^). □ 

We now turn to the connection between subsequential limits and 
lim sup's and liminf's. 

11.7 Theorem. 

Let (sn) be any sequence. There exists a monotonic subsequence 
whose limit is lim sup and there exists a monotonic subsequence 
whose limit is lim inf 5^7 . 



2. Sequences 
Proof 

If (sn) is not bounded above, then by Theorem 11.2(ii), a monotonic 
subsequence of (s^) has hmit +00 = hm sup^T^. Similarly, if (57^) 
is not bounded below, a monotonic subsequence has limit — 00 = 
lim inf 5^. 

The remaining cases are that (5^) is bounded above or is bounded 
below. These cases are similar, so we only consider the case that (5^) 
is bounded above, so that lim sup 5^ is finite. Let t = lim sup 5^, and 
consider e > 0. There exists A^o so that 

sup{5^ :n> N} <t + e for N > Nq. 

In particular, 5^ < t + e for all n > Nq. We now claim 

{n e N : t - e < Sn < t ^ e} is infinite. (1) 

Otherwise, there exists A^i > A^o so that 5^ < ^ — e for n > A^i. Then 
sup{5^ : n > N} < t — e ioi N > Ni^ so that lim sup 5^ < t, a contra- 
diction. Since (1) holds for each e > 0, Theorem 11.2(i) shows that 
a monotonic subsequence of (5^) converges to t = lim sup 5^. ■ 

11.8 Theorem. 

Let (sji) be any sequence in and let S denote the set of 
suhsequential limits of (sn)- 
(i) S is nonempty. 

(ii) sup S = lim sup Sn and inf S = lim inf 5^. 

(iii) lim Sn exists if and only if S has exactly one element, namely 
lim Sn- 

Proof 

(i) is an immediate consequence of Theorem 11.7. 

To prove (ii), consider any limit t of a subsequence (5^^) of (5^). 
By Theorem 10.7 we have t = lim inf = limsup^s^^. Since 
Uk > k for all A;, we have {5^^ : k > N} C {5^ : n > N} for each 
in N. Therefore 

lim inf Sn < lim inf =t = lim sup < lim sup 5^. 

n k k n 

This inequality holds for all t in S] therefore 

lim inf Sn < inf S < sup S < lim sup 5^. 
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Theorem 11.7 shows that hminf and hmsup both belong to S. 
Therefore (ii) holds. 

Assertion (hi) is simply a reformulation of Theorem 10.7. ■ 

Theorems 11.7 and 11.8 show that limsup is exactly the largest 
subsequential limit of (5^), and liminf Sn is exactly the smallest sub- 
sequential limit of (sn)- This makes it easy to calculate lim sup's and 
lim inf 's. 

We return to the examples given before Theorem 11.7. 
Example 9 

If Sn = 1)^, then S = {—00, +00} as noted in Example 5. 

Therefore lim sup 5^ — sup 5 — +00 and lim inf 5^ = inf 5 = 
-oc. □ 



Example 10 

If an = sin(^), then S = { — 0, as observed in Exam- 

ple 6. Hence lim sup — sup 5 — ^\/3 and lim inf — inf 5 — 
-^V3. □ 

Example 11 

If (vn) denotes a list of all rational numbers, then the set R U 
{— (X),+(X)} is the set of subsequential limits of (r^). Consequently 
we have lim sup — +00 and liminf = — 00. □ 

Example 12 

If bn = ^[1 + (—1)^], then limsup 6^ = +00 and liminf 6^ = 0; see 
Example 8. □ 

The next result shows that the set S of subsequential lim- 
its always contains all limits of sequences from S. Such sets are 
called closed sets. Sets of this sort will be discussed further in the 
enrichment §13. 

11.9 Theorem. 

Let S denote the set of subsequential limits of a sequence (5^). Sup- 
pose (tn) is a sequence in S HM. and that t = limt^. Then t belongs 
to S. 
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Proof 

Suppose t is finite. Consider the interval (t — e, t + e). Then some tn 
is in this interval. Let 6 — min{t + e — t^, — t + e}, so that 

Since is a subsequential limit, the set {n G N : 5^ G (t^ — 5, + 
is infinite, so the set {n G N : Sn G (t — e,t + e)} is also infinite. Thus, 
by Theorem 11.2(i), t itself is a subsequential limit of (sj^). 

If t = +00, then clearly the sequence (5^) is unbounded above, 
so a subsequence of (5^) has limit +00 by Theorem 11.2(ii). Thus 
+OC is also in 5. A similar argument applies if t = — 00. ■ 



Exercises 

11.1 Let an = 3 + 2(-l)^ for n G N. 

(a) List the first eight terms of the sequence (an). 

(b) Give a subsequence that is constant [takes a single value]. 
Specify the selection function a. 

11.2 Consider the sequences defined as follows: 

i\n h - - - 2 J _ 6n + 4 

n In — 6 

(a) For each sequence, give an example of a monotone subse- 
quence. 

(b) For each sequence, give its set of subsequential limits. 

(c) For each sequence, give its limsup and liminf. 

(d) Which of the sequences converges? diverges to +oc? diverges 
to — oc? 

(e) Which of the sequences is bounded? 

11.3 Repeat Exercise 11.2 for the sequences: 

/^^N , 3 / , 1 

5n=COs(— -), tn = - — r, = " " , = (-1) + 

3 4n + l V2/ n 



11 A Repeat Exercise 11.2 for the sequences: 

Wn = {-2Y, Xn=5^"^^", yn = l^{-lT, Zn = ^ COS ( 
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11.5 Let {(In) be an enumeration of all the rationals in the interval (0, 1]. 

(a) Give the set of subsequential limits for (g^)- 

(b) Give the values of limsupg^ and liminf q^. 

11.6 Show every subsequence of a subsequence of a given sequence is itself 
a subsequence of the given sequence. Hint'. Define subsequences as 
in (3) of Definition 11.1. 

11.7 Let (vn) be an enumeration of the set Q of all rational numbers. Show 
there exists a subsequence (r^^) such that lim/g^oo = +oo. 

11.8 Use Definition 10.6 and Exercise 5.4 to prove liminf 5^ = 
— limsup(— 5n) for every sequence (sn). 

11.9 (a) Show the closed interval [a, 6] is a closed set. 

(b) Is there a sequence (s^) such that (0, 1) is its set of subsequential 
limits? 

11.10 Let (sn) be the sequence of numbers in Fig. 11.2 listed in the indicated 
order. 

(a) Find the set 5' of subsequential limits of (s^). 

(b) Determine limsups^ and liminf Sn- 



This exercise is referred to in several places. 
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11.11 Let 5' be a bounded set. Prove there is an increasing sequence (sn) of 
points in S such that hms^ = sup 5. Compare Exercise 10.7. Note: 
If sup 5' is in S', it's sufficient to define Sn = sup 5' for all n. 



§12 lim sup's and liminf's 

Let (sji) be any sequence of real numbers, and let S be the set of 
subsequential limits of (5^). Recall 

limsup Sn = lim sup {sn : n > N} = sup S (*) 

and 

liminf Sn = lim inf {sn : n > N} = inf S. (**) 

N^oo 

The first equalities in (*) and (**) are from Definition 10.6, and 
the second equalities are proved in Theorem 11.8. This section is de- 
signed to increase the students' familiarity with these concepts. Most 
of the material is given in the exercises. We illustrate the techniques 
by proving some results that will be needed later in the text. 

12.1 Theorem. 

If{sn) converges to a positive real number s and (tn) is any sequence, 
then 

lim sup Sjitn — s • lim sup tn- 

Here we allow the conventions s • (+oc) — +00 and s • (—00) — —00 
for 5 > 0. 

Proof 

We first show 

lim sup Sjitn > s ' lim sup tn- (1) 

We have three cases. Let /3 = lim sup t^. 
Case 1. Suppose /3 is finite. 

By Theorem 11.7, there exists a subsequence (t^^) of (t^) such 
that liuik^^trif^ — j3. We also have limj^^^Sn^ — s [by Theo- 
rem 11.3], so liuik^^ ^nk^nk = <5^- Thus {snktuk) is a subsequence of 
{sjitn) converging to 5/3, and therefore 5/3 < limsup Sntn- [Recall that 
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limsnp Sntn is the largest possible limit of a subsequence of (s^t^).] 
Thus (1) holds. 

Case 2. Suppose /3 = +00. 

There exists a subsequence (tnj^) of (t^) such that limk^^tnj^ = 
+00. Since limj^^^ s^^ = 5 > 0, Theorem 9.9 shows Iyuij^^qq ^nk^nk — 
+OC. Hence limsups^t^ = +00, so (1) clearly holds. 

Case 3. Suppose /3 — —00. 

Since 5 > 0, the right-hand side of (1) is equal to s- (—00) = —00. 
Hence (1) is obvious in this case. 

We have now established (1) in all cases. For the reversed in- 
equality, we resort to a little trick. First note that we may ignore 
the first few terms of (5^) and assume all ^ 0. Then we can write 
lim ^ = ^ by Lemma 9.5. Now we apply (1) with Sn replaced by ^ 
and tji replaced by Sntn- 

lim sup = lim sup ( — ) {sntn) ^ ( - ) lim sup 5^^^, 

i.e., 

lim sup Sntji < s • lim sup tn- 
This inequality and (1) prove the theorem. ■ 



Example 1 

The hypothesis s be positive in Theorem 12.1 cannot be relaxed to 
allow 5 = 0. To see this, consider (5^) and (t^), where 5^ = — - and 
tn = —n^ for all n. In this setting, we don't define 0 • (—00), but even 
if we did, we wouldn't define this product to be +00. □ 

The next theorem will be useful in dealing with infinite series; 
see the proof of the Ratio Test 14.8. 

12.2 Theorem. 

Let (sn) be any sequence of nonzero real numbers. Then we have 



lim inf 



< lim inf Is^l"*^/^ < lim sup l^^l"*^/^ < lim sup 
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Proof 

The middle inequality is obvious. The first and third inequalities 
have similar proofs. We will prove the third inequality and leave the 
first inequality to Exercise 12.11. 

Let a = limsup and L = limsup We need to prove 

a < L. This is obvious if L = +00, so we assume L < +00. To prove 
a < L it suffices to show 



a < Li for any Li > L. 



(1) 



Since 



L = lim sup 



= lim sup 

N^oo 



:n> N} <L 



there exists a positive integer such that 



sup 



Thus 



< Li for n > A^. 



(2) 



Now for n > we can write 



Sn-l 



Sfi-l 



Sn-2 



SN+1 



There are n — {N + l) + l = n — A^ fractions here, so applying (2) 
we see that 



< ^I^Tvl for n> N. 

Since Li and A^ are fixed in this argument, a = L^^I^tvI is a positive 
constant and we may write 



< L^a for n> N. 



Therefore we have 



< Lia^/^ for n>A^. 

omce 

lim^^oo a^/" = 1 by Theorem 9.7(d) on page 48, we conclude 
a = limsup l^^l-*^/^ < Li; see Exercise 12.1. Consequently (1) holds 
as desired. ■ 
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12.3 Corollary. 

// lim I I exists [and equals L], then lim \sn\^/^ exists [and 
equals L]. 

Proof 

If lim I I = L, then all four values in Theorem 12.2 are equal to L. 
Hence lim = L; see Theorem 10.7. ■ 

Example 2 

(a) If L = lim sup 5^ ^ oo, then for every a > the set {n : 
Sji > a} is finite. If L ^ — oo, then for every /3 < L, the set 
{n : Sji > /3} is infinite. 

If L ^ oo and a > the set {n : > a} is finite; otherwise 
sup{s^ : n > N} > a for all and hence L = lim sup 5^ > 
a > L, a contradiction; see Definition 10.6. If L ^ — oo and 
/3 < the set {n : Sn > /3} is infinite; otherwise there exists a 
positive integer A^o so that 5^ < /3 for all n > Nq, and therefore 
sup{5^ : n > TV} < /? for all TV > Nq. Then lim sup 5^ < /3 < L, 
a contradiction. 

(b) The set {n : Sn > lim sup 5^} can be infinite. For example, 
consider (5^) where 5^ = ^. The set {n : Sn < liminf Sn} can 
also be infinite; use 5^ = — ^. 

(c) If Lq = liminf t^ ^ —00, then the set {n : tn < /3o} is finite for 
/3o < Lq. If Lq 7^ 00, then the set {n : tn < «o} is infinite for 
«o > ^0- 

This follows from part (a) and Exercise 11.8: 

Lq = lim inf tn = — lim sup(— t^) = —L = — lim sup 5^, 

where Sn = —tn and L is as defined in part (a). Now /3o < Lq 
implies —/3o > —Lq = L, so by part (a), 

{n:tn < /3o} = {n : -tn > -^0} = {n : 5^ > -(3o} is finite. 
Similarly, ao > Lq implies —ao < L, so 

{n : tn < «o} = • —tn > — <^o} = {"1^ Sn > " <^o} IS infinite. 

(d) If liminf Sn < lim sup 5^, the set 

{n : liminf 5^ < 5^ < lim sup Sn} 
can be empty. Use, for example, Sn = (—1)^(1 + □ 
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Exercises 

12.1 Let {sn) and (tn) be sequences and suppose there exists Nq such that 
Sn ^ tn for all n > Nq. Show liminf Sn < liminf and limsupsn < 
limsuptn- Hint: Use Definition 10.6 and Exercise 9.9(c). 

12.2 Prove limsup 1 5^1 = 0 if and only if limsn = 0. 

12.3 Let {sn) and {tn) be the following sequences that repeat in cycles of 
four: 

{sn) = (0,1,2,1,0,1,2,1,0,1,2,1,0,1,2,1,0,...) 
{tn) = (2,1,1,0,2,1,1,0,2,1,1,0,2,1,1,0,2,...) 

Find 

(a) liminf Sn + liminf t^, (b) liminf (s^ + ^n), 
(c) liminf Sn + limsup^n, (d) limsup(sn + tn), 
(e) limsup 5n + limsup (f) liminf(5ntn), 

(g) limSUp(5ntn) 

12.4 Show limsup(5n+tn) ^ limsup 5n + limsup for bounded sequences 
{sn) and {tn)- Hint: First show 

supjsn -^tn : n > N} < supjsn : n > N} + supjtn • ^ > 

Then apply Exercise 9.9(c). 

12.5 Use Exercises 11.8 and 12.4 to prove 

liminf (sn + tn) > liminf Sn + liminf tn 
for bounded sequences {sn) and (tn). 

12.6 Let {sn) be a bounded sequence, and let k he a nonnegative real 
number. 

(a) Prove lim sup (/c5n) = k • limsupsn- 

(b) Do the same for liminf. Hint: Use Exercise 11.8. 

(c) What happens in (a) and (b) if /c < 0? 

12.7 Prove if limsupsn = +oc and /c > 0, then limsup(/c5n) = +oo. 

12.8 Let {sn) and (tn) be bounded sequences of nonnegative numbers. 
Prove lim sup 5ntn < (lim sup 5n )(lim sup tn). 

12.9 (a) Prove that if hm Sn — -|-cxD and liminf tn ^ 0, then lim 5ntn — 

+ OC. 

(b) Prove that if limsupsn = +oo and liminf tn > 0, then 

lim sup 5ntn = +OC. 
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(c) Observe that Exercise 12.7 is the special case of (b) where tn = k 
for all n G N. 

12.10 Prove {sn) is bounded if and only if limsup \sn\ < +oo. 

12.11 Prove the first inequality in Theorem 12.2. 

12.12 Let (sn) be a sequence of nonnegative numbers, and for each n define 

CTn = ^{Sl + 52 H h 5n). 

(a) Show 

liminf Sn < liminf (in < limsupan < limsup s^. 
Hint: For the last inequality, show first that M > N implies 

SUp{crn : n > M} < -^(5i+52H h5Ar)+SUp{5n I Tl > N} . 

(b) Show that if lims^ exists, then liman exists and liman = 
\imsn- 

(c) Give an example where lim cr^ exists, but lim Sn does not exist. 

12.13 Let {sn) be a bounded sequence in M. Let A be the set of a G M such 
that {n G N : 5n < a} is finite, i.e., all but finitely many Sn are > a. 
Let B be the set of 6 G M such that {n G N : 5^ > 6} is finite. Prove 
sup A = liminf Sn and inf B = lim sup 5^. 

12.14 Calculate (a) lim(n!)i/^, (b) lim^(n!)i/^. 



§13 * Some Topological Concepts in Metric 
Spaces 

In this book we are restricting our attention to analysis on R. Ac- 
cordingly, we have taken full advantage of the order properties of M 
and studied such important notions as lim sup's and lim inf 's. In §3 
we briefly introduced a distance function on R. Most of our analy- 
sis could have been based on the notion of distance, in which case 
it becomes easy and natural to work in a more general setting. For 
example, analysis on the /c-dimensional Euclidean spaces is im- 
portant, but these spaces do not have the useful natural ordering 
that R has, unless of course k = 1. 
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13.1 Definition. 

Let 5 be a set, and suppose d is a function defined for all pairs (x, y) 
of elements from S satisfying 

Dl. d(x^ x) = 0 for all X G 5 and d{x^ y) > 0 for distinct x, y in S. 

D2. d{x,y) = d{y,x) for all x,y ^ S. 

D3. c?(x, z) < ^) + d{y^ z) for all x,y,z ^ S. 

Such a function d is called a distance function or a metric on 5. 
A metric space 5 is a set S together with a metric on it. Properly 
speaking, the metric space is the pair (5, d) since a set S may well 
have more than one metric on it; see Exercise 13.1. 



Example 1 

As in Definition 3.4, let dist(a, b) = \a — b\ for a, 6 G M. Then dist is 
a metric on M. Note Corollary 3.6 gives D3 in this case. As remarked 
there, the inequality 

dist(a, c) < dist(a, b) + dist(6, c) 

is called the triangle inequality. In fact, for any metric d, property 
D3 is called the triangle inequality. □ 



Example 2 

The space of all /c-tuples 



X = (xi, X2, . . . , Xk) where xj G 



for j = l,2,...,A;, 



is called k- dimensional Euclidean space and written R^. As noted in 
Exercise 13.1, has several metrics on it. The most familiar metric 
is the one that gives the ordinary distance in the plane 
3-space R^: 



or m 



d{x,y) 



k 

E 

3=1 



1/2 



for x,y e 



[The summation notation ^ is explained in 14.1.] Obviously this 
function d satisfies properties Dl and D2. The triangle inequality 
D3 is not so obvious. For a proof, see for example [53, §6.1] or 
[62, 1.37]. □ 



§13. * Some Topological Concepts in Metric Spaces 



13.2 Definition. 

A sequence (5^) in a metric space {S, d) converges to s in S if 
liuin^^ d{sn^ s) = 0. A sequence (5^) in 5 is a Cauchy sequence 
if for each e > 0 there exists an N such that 

m^n> N imphes d{sm^Sn) < e. 

The metric space (5, d) is said to be complete if every Cauchy 
sequence in S converges to some element in S. 

Since the Completeness Axiom 4.4 deals with least upper bounds, 
the word "complete" now appears to have two meanings. However, 
these two uses of the term are very closely related and both reflect the 
property that the space is complete, i.e., has no gaps. Theorem 10.11 
asserts that the metric space (R, dist) is a complete metric space, and 
the proof uses the Completeness Axiom 4.4. We could just as well 
have taken as an axiom the completeness of (M, dist) as a metric space 
and proved the least upper bound property in 4.4 as a theorem. We 
did not do so because the concept of least upper bound in R seems 
to us more fundamental than the concept of Cauchy sequence. 

We will prove R^ is complete. But we have a notational problem, 
since we like subscripts for sequences and for coordinates of points 
in R^. When there is a conflict, we will write (x^^^) for a sequence 
instead of (x^). In this case, 

^{n) _ ( (n) Jn) Jn). 

Unless otherwise specified, the metric in R^ is always as given in 
Example 2. 

13.3 Lemma. 

A sequence (cc^^^) in R^ converges if and only if for each j = 
1,2,...,/C; the sequence (x^-^^) converges in R. A sequence (x^^^) 

in R^ is a Cauchy sequence if and only if each sequence (x^-^^) is a 
Cauchy sequence in R. 

Proof 

The proof of the first assertion is left to Exercise 13.2(b). For the 
second assertion, we first observe for x, y in R^ and j = 1, 2, . . . , /c, 

\xj - yj\ < d{x,y) < \/fcmax{|x^- - yj\ : j = 1, 2, . . . , A;}. (1) 
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Suppose (x^^)) is a Cauchy sequence in R^, and consider fixed j. 
If e > 0, there exists such that 

m,n> N imphes d(cc('^\ x^"")) < e. 

From the first inequahty in (1) we see that 

^ AT- • T I (^) (^) I / 

m, n > 7V imphes \x^- — | < e, 

so {x^P^) is a Cauchy sequence in R. 

Now suppose each sequence {x^^^) is a Cauchy sequence in R. Let 
6 > 0. For j = 1, 2, . . . , A;, there exist Nj such that 

^ AT- • T I (^) (^) I ^ ^ 

m.n > 7Vo imphes kc'- — x'- < 

li N = max{A^i, . . . , Nj^}, then by the second inequahty in (1), 

m,n> N imphes d{x'''^\x'''^'>) < e, 
i.e., (x^^)) is a Cauchy sequence in R^. ■ 

13.4 Theorem. 

Euclidean k -space R^ is complete. 
Proof 

Consider a Cauchy sequence (x^^^) in R^. By Lemma 13.3, (x^-^^) 
is a Cauchy sequence in R for each j. Hence by Theorem 10.11, 
(x^-^^) converges to some real number Xj. By Lemma 13.3 again, the 
sequence (x^^^) converges, in fact to x = (xi, ^2, . . . , x^)- ■ 

We now prove the Bolzano- Weierstrass theorem for R^; compare 
Theorem 11.5. A set 5 in R^ is bounded if there exists M > 0 such 
that 

max{|xj| : j = 1, 2, . . . , A:} < M for all x = {xi,X2, . . . , Xk) G S. 

13.5 Bolzano- Weierstrass Theorem. 

Every bounded sequence in R^ has a convergent subsequence. 

Proof 

Let (x^^)) be a bounded sequence in R^. Then each sequence (x^-^^) 
is bounded in R. By Theorem 11.5, we may replace (x^^^) by a 
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subsequence such that (x^^^) converges. By the same theorem, we 
may replace (cc^^^) by a subsequence of the subsequence such that 
) converges. Of course, {x^^^) still converges by Theorem 11.3. 
Repeating this argument k times, we obtain a sequence {x^^^) so 
that each sequence {x^^^) converges, j = 1, 2, . . . , A;. This sequence 
represents a subsequence of the original sequence, and it converges 
in by Lemma 13.3. ■ 

13.6 Definition. 

Let (5, d) be a metric space. Let be a subset of S. An element 
So ^ E \s interior to E if for some r > 0 we have 

{s^S : d{s,so) <r}CE. 

We write E^ for the set of points in E that are interior to E. The 
set E is open in S if every point in E is interior to i.e., if E = E° . 

13.7 Discussion. 

One can show [Exercise 13.4] 
(i) S is open in S [trivial], 
(ii) The empty set 0 is open in S [trivial]. 

(iii) The union of any collection of open sets is open. 

(iv) The intersection of finitely many open sets is again an open 
set. □ 

Our study of and the exercises suggest that metric spaces are 
fairly general and useful objects. When one is interested in conver- 
gence of certain objects [such as points or functions], there is often 
a metric that assists in the study of the convergence. But sometimes 
no metric will work and yet there is still some sort of convergence no- 
tion. Frequently the appropriate vehicle is what is called a topology. 
This is a set S for which certain subsets are decreed to be open sets. 
In general, all that is required is that the family of open sets satisfies 
(i)-(iv) above. In particular, the open sets defined by a metric form a 
topology. We will not pursue this abstract theory. However, because 
of this abstract theory, concepts that can be defined in terms of open 
sets [see Definitions 13.8, 13.11, and 22.1] are called topological, hence 
the title of this section. 
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13.8 Definition. 

Let (5, d) be a metric space. A subset E of S is closed if its comple- 
ment S \ E is diU open set. In other words, E is closed ii E = S \ U 
where U is an open set. 

Because of (iii) in Discussion 13.7, the intersection of any collec- 
tion of closed sets in closed [Exercise 13.5]. The closure E~ of a set 
E is the intersection of all closed sets containing E. The boundary 
of E is the set E~ \ points in this set are called boundary points 
ofE. 

To get a feel for these notions, we state some easy facts and leave 
the proofs as exercises. 

13.9 Proposition. 

Let E be a subset of a metric space (5, d). 

(a) The set E is closed if and only if E — E~ . 

(b) The set E is closed if and only if it contains the limit of every 
convergent sequence of points in E. 

(c) An element is in E~ if and only if it is the limit of some 
sequence of points in E. 

(d) A point is in the boundary of E if and only if it belongs to the 
closure of both E and its complement. 

Example 3 

In R, open intervals (a, h) are open sets. Closed intervals [a, h] are 
closed sets. The interior of [a, h] is (a, h). The boundary of both (a, b) 
and [a, 6] is the two-element set {a, 6}. 

Every open set in M is the union of a disjoint sequence of open 
intervals [Exercise 13.7]. A closed set in R need not be the union of 
a disjoint sequence of closed intervals and points; such a set appears 
in Example 5. 

No open interval (a, 6) or closed interval [a, 6], with a < b, can 
be written as the disjoint union of two or more closed intervals, each 
having more than one point. This is proved in Theorem 21.11. □ 

Example 4 

In R^, open balls {x : d{x^xo) < r} are open sets, and closed balls 
{x : d{x,XQ) < r} are closed sets. The boundary of each of these 
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sets is {x : d{x, xq) = r}. In the plane R^, the sets 

{(xi,X2) : xi > 0} and {(xi,X2) : xi > 0 and X2 > 0} 

are open. If > is replaced by >, we obtain closed sets. Many sets 
are neither open nor closed. For example, [0, 1) is neither open nor 
closed in R, and {(xi,X2) : xi > 0 and X2 > 0} is neither open nor 
closed in R2. □ 

13.10 Theorem. 

Let (Fn) be a decreasing sequence [i.e., Fi D F2 ^ • • •] of closed 
bounded nonempty sets in R^. Then F = Pl^^^F^ is also closed, 
bounded and nonempty. 

Proof 

Clearly F is closed and bounded. It is the nonemptiness that 
needs proving! For each n, select an element Xn in F^. By the 
Bolzano- Weierstrass Theorem 13.5, a subsequence {xn^)^^^ of (xn) 
converges to some element xq in R^. To show xq G F, it suf- 
fices to show Xq G FriQ with no fixed. If m > no, then n^ > no, 
so Xn^ G Fn^ C FnQ. Heucc the sequence {xnm)m=no consists of 
points in F^^ and converges to xq. Thus xq belongs to F^^ by (b) of 
Proposition 13.9. ■ 

Example 5 

Here is a famous nonempty closed set in R called the Cantor set. 
Pictorially, F = H^^F^ where F^ are sketched in Fig. 13.1. The 
Cantor set has some remarkable properties. The sum of the lengths of 
the intervals comprising Fn is (f)^""^ and this tends to 0 as n ^ 00. 
Yet the intersection F is so large that it cannot be written as a 
sequence; in set-theoretic terms it is "uncountable." The interior 
of F is the empty set, so F is equal to its boundary. For more details, 
see [62, 2.44], or [31, 6.62]. □ 

13.11 Definition. 

Let (S, d) be a metric space. A family U of open sets is said to be an 
open cover for a set E if each point of E belongs to at least one set 
in U, i.e., 



E C |J{C/ :U ^U}. 
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FIGURE 13.1 

A subcover of U is any subfamily of U that also covers E. A cover 
or subcover is finite if it contains only finitely many sets; the sets 
themselves may be infinite. 

A set E is compact if every open cover of E has a finite subcover 
of E. 

This rather abstract definition is very important in advanced 
analysis; see, for example, [30]. In M^, compact sets are nicely 
characterized, as follows. 

13.12 Heine-Borel Theorem. 

A subset E of is compact if and only if it is closed and bounded. 
Proof 

Suppose E is compact. For each m G N, let Um consist of all x in 
such that 

max{|xj| : j = 1, 2, . . . , A;} < m. 

The family U = {Um : m G N} is an open cover of E [it covers R^!], 
so a finite subfamily of U covers E. If Umo is the largest member of 
the subfamily, then E C C/^q. It follows that E is bounded. To show 
E is closed, consider any point xq iuR^ \E. For m G N, let 

Vm = \ x eR^ : d(x,xo) > — 

m 
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Then each Vm is open in and V = {Vm : m G N} covers E since 
^m=i^'rn = \ {xq}- Sincc E Can be covered by finitely many Vm, 
for some mo we have 

E (Z Ix eR^ : d(x,xo) > — 
I mo 

Thus {cc G : d{x,xo) < ^} CR^\E, so that xq is interior to 
\ E. Since xo in R^ \ was arbitrary, R^ \ is an open set. Hence 
is a closed set. 

Now suppose E is closed and bounded. Since E is bounded, E is 
a subset of some set F having the form 

F = {xeR^ : \xj\ < m for j = 1,2,. . . 

As noted in Exercise 13.12, it suffices to prove F is compact. We do 
so in the next proposition after some preparation. ■ 

The set F in the last proof is a k-cell because it has the following 
form. There exist closed intervals [ai, [a2, 62], • • • , [dk, ^fc] so that 

F^{x^R^ :xj^ [aj.hj] for j = 1, 2, . . . , /c}, 

which is sometimes written as 

F = [ai, 61] X [a2, 62] X • • • X [a/,, 6^], 

so it is a /c-dimensional box in R^. Thus a 2-cell in R^ is a closed 
rectangle. A 3-cell in R^ is called a "rectangular parallelepiped." The 
diameter of F is 

^{hj - aj) 

that is, 5 = sup{(i(x, y) : x^y ^ F}. Using midpoints cj = ^{aj +bj) 
of [ttj, we see that F is a union of 2^ fc-cells each having diameter 
|. If this remark is not clear, consider first the cases k — 2 and k — ?>. 



13.13 Proposition. 

Every k-cell F in R^ is compact. 

Proof 

Assume F is not compact. Then there exists an open cover of F, no 
finite subfamily of which covers F. Let 5 denote the diameter of F. 
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As noted above, F is a union of 2^ fc-cells having diameter |. At least 
one of these 2^ fc-cehs, which we denote by Fi, cannot be covered 
by finitely many sets from lA. Likewise, Fi contains a fc-cell F2 of 
diameter | which cannot be covered by finitely many sets from lA. 
Continuing in this fashion, we obtain a sequence (F^) of fc-cells such 
that 

Fi D F2 2 F3 2 • • • ; (1) 

Fn has diameter 5 • 2~^; (2) 
Fn cannot be covered by finitely many sets from U. (3) 

By Theorem 13.10, the intersection r\^^iFn contains a point xq- This 
point belongs to some set U{) in U. Since i7o is open, there exists r > 0 
so that 

It follows that Fn ^ C/q provided 5 • 2~^ < r, but this contradicts (3) 
in a dramatic way. ■ 

Since R = R-*^, the preceding results apply to R. 

Example 6 

Let F be a nonempty subset of a metric space (5, d). Consider the 
function d(F, x) = m.i{d{y^x) : y G F} for x ^ S. This function 
satisfies |d(F, xi) — d(F,X2)| < d(xi,X2) for xi,X2 in S. 

We show that if F is compact and if F C [/ for some open subset 
U of 5, then for some 5 > 0 we have 

{x^S: d{E,x) <5}(ZU. (1) 

For each x G F, we have 

{y ^ S \ d{y^ x) < Tx} for some > 0. (2) 

The open balls {y ^ S : d{y, x) < rx/2} cover F, so a finite subfamily 
also covers F. Le., there are xi, . . . , in F so that 

n 

EC |J{2/G5:%,x,)<^}, 

k=i 

where we write rk for r^^^. Now let 6 = ^ min{ri, . . . , r^}. To 
prove (1), consider x ^ S and suppose d{E,x) < 6. Then for some 
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y ^ we have d{y,x) < 6. Moreover, d{y,Xk) < ^ for some 
/c G {1, 2, . . . , n}. Therefore, for this k we have 

d{x, Xk) < d{x, y) + d{y, x^t) < ^ + y < y + y = ^fc- 

Thus, by (2) apphed to x = x^i we see that x belongs to U . Hence (1) 
holds. □ 



Exercises 

13.1 For points x, y in R^, let 

di{x,y) =max{\xj - yj\ : j = 1, 2, . . . , /c} 

and 

k 

(a) Show di and d2 are metrics for M^. 

(b) Show di and d2 are complete metrics on M^. 

13.2 (a) Prove (1) in Lemma 13.3. 

(b) Prove the first assertion in Lemma 13.3. 

13.3 Let B be the set of all bounded sequences x = (xi, X2, . . .), and define 
d{x,y) = sup{\xj -yj\:j = 1,2,...}. 

(a) Show d is a metric for B. 

(b) Does d*{x^y) = Xljli ki ~ ^il define a metric for Bl 

13.4 Prove (iii) and (iv) in Discussion 13.7. 

13.5 (a) Verify one of DeMorgan's Laws for sets: 

[^{S \U :U eU} = S\ [j{U :U eU}. 

(b) Show that the intersection of any collection of closed sets is a 
closed set. 

13.6 Prove Proposition 13.9. 

13.7 Show that every open set in M is the disjoint union of a finite or 
infinite sequence of open intervals. 
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13.8 (a) Verify the assertions in the first paragraph of Example 3. 
(b) Verify the assertions in Example 4. 

13.9 Find the closures of the following sets: 

(a) {i : n G N}, 

(b) Q, the set of rational numbers, 

(c) {r G Q : < 2}. 

13.10 Show that the interior of each of the following sets is the empty set. 

(a) {i : n e N}, 

(b) Q, the set of rational numbers, 

(c) The Cantor set in Example 5. 

13.11 Let £^ be a subset of M^. Show that E is compact if and only if every 
sequence in E has a subsequence converging to a point in E. 

13.12 Let {S^d) be any metric space. 

(a) Show that if £^ is a closed subset of a compact set F, then E 
is also compact. 

(b) Show that the finite union of compact sets in S is compact. 

13.13 Let E he Si compact nonempty subset of R. Show sup£^ and inf E 
belong to E. 

13.14 Let £^ be a compact nonempty subset of M^, and let 6 = sup{(i(cc, y) : 
x,y e E}. Show E contains points ccq, Vo such that d{xo^yo) = S. 

13.15 Let (5, d) be as in Exercise 13.3, and let F consist of all x G B such 
that sup{|xj| : j = 1, 2, . . .} < 1. 

(a) Show F is closed and bounded. [A set F in a metric space 
(5', d) is bounded if there exist sq G S and r > 0 such that 
F C{seS : d{s,so) < r}.] 

(b) Show F is not compact. Hint: For each x in F, let U{x) = 
{y G B : d{y^ x) < 1}, and consider the cover U of F consist- 
ing of all U{x). For each n G N, let x'^^^ be defined so that 

= — 1 and x^^^ = 1 for j 7^ n. Show that distinct cc^^^ 
cannot belong to the same member of U. 
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Our thorough treatment of sequences allows us to now quickly obtain 
the basic properties of infinite series. 

14.1 Summation Notation. 

The notation Yl^=m is shorthand for the sum a^ + a^+iH ha^. 

The symbol "X^" instructs us to sum and the decorations "/c = m" 
and "n" tell us to sum the summands obtained by successively sub- 
stituting m, m+ 1, . . . , n for A;. For example, Ylk=2 shorthand 
for 

1 1 1 11111 

+ 1^ 7: + 7 + 1^ r = + + — + 



22 + 2 32 + 3 42 + 4 52 + 5 6 12 20 30 

and J2k=o 2"^ is shorthand forl + ^ + ^H h^. 

The symbol is shorthand for + a^+i + H , 

although we have not yet assigned meaning to such an infinite sum. 
We now do so. □ 



CXO 

nJn=m 



14.2 Infinite Series. 

To assign meaning to X^^m we consider the sequences {s 
of partial sums: 

n 

Sn = Cim+ Cim+1 H + Cin = ^ Cik- 

k=m 

The infinite series J2^=m is said to converge provided the sequence 
(sji) of partial sums converges to a real number 5, in which case we 
define 5]^^ = S. Thus 

00 / ^ \ 

= S means lim Sn = S or lim |> ] = S. 

n=m \k=m / 

A series that does not converge is said to diverge. We say that 
J2^=m diverges to +00 and we write X^^^ cin — +c>o provided 
lim Sn = +00; a similar remark applies to —00. The symbol J2^=m 
has no meaning unless the series converges, or diverges to +00 or 
—00. Often we will be concerned with properties of infinite series 
but not their exact values or precisely where the summation begins, 
in which case we may write ^ rather than X^^^ a^- 
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If the terms of an infinite series X^a^ are all nonnegative, 
then the partial sums (sn) form an increasing sequence, so Theo- 
rems 10.2 and 10.4 show that X^^n either converges, or diverges 
to +00. In particular, X]|a^| is meaningful for any sequence (a^) 
whatever. The series ^ is said to converge absolutely or to be ab- 
solutely convergent if ^ |a^| converges. Absolutely convergent series 
are convergent, as we shall see in Corollary 14.7. □ 



Example 1 

A series of the form J2^=o constants a and r is called a 

geometric series. These are the easiest series to sum. For r ^ 1, the 
partial sums Sn are given by 

This identity can be verified by mathematical induction or by mul- 
tiplying both sides by 1 — r, in which case the right hand side equals 
a — ar^^^ and the left side becomes 

n n n 

(1 - r) ^ ar^ = ^cir^ - ^ ar^^^ 

k=0 k=0 k=0 

= a + ar + ar^ + • • • + ar^ 



-{ar + ar'^^ h ar"" + ar""^^^ 

= a - ar^+^ 



For |r| < 1, we have lim^^oo r^^^ = 0 by Theorem 9.7(b) on page 48, 
so from (1) we have lim^^oo <Sn — ^rzf This proves 
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ar^ = if Irl < 1. (2) 

1 — r 

n=0 

If a 7^ 0 and |r| > 1, then the sequence (ar^) does not converge to 
0, so the series ^ar^ diverges by Corollary 14.5 below. □ 

Example 2 

Formula (2) of Example 1 and the next result are very important 
and both should be used whenever possible, even though we will not 
prove (1) below until the next section. Consider a fixed positive real 
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number p. Then 

(X) ^ 

— converges if and only if p > 1. (1) 

n=l 

In particular, for p < 1, we can write = +00. The exact 

values of the series for p > 1 are not easy to determine. Here are 
some remarkable formulas that can be shown by techniques [Fourier 
series or complex variables, to name two possibilities] that will not 
be covered in this text. 

E:r=i;^ = ^ = l-6449..., (2) 
E:Li7?-S- 1-0823---. (3) 

Similar formulas hold for X^^i ^ when p is any even integer, but 
no such elegant formulas are known for p odd. In particular, no such 
formula is known for J2^=i ^ though of course this series converges 
and can be approximated as closely as desired. □ 



It is worth emphasizing that it is often easier to prove limits exist 
or series converge than to determine their exact values. In the next 

section we will show without much difficulty that Yl ^ converges for 

2 

all p > 1, but it is a lot harder to show the sum is ^ when p — 2 
and no one knows exactly what the sum is for p = 3. 



14.3 Definition. 

We say a series ^ satisfies the Cauchy criterion if its sequence 
{sn) of partial sums is a Cauchy sequence [see Definition 10.8]: 

for each e > 0 there exists a number such that 

m,n > N implies \sn — Sm\ < ^- (1) 

Nothing is lost in this definition if we impose the restriction n > m. 
Moreover, it is only a notational matter to work with m — 1 where 
m < n instead of m where m < n. Therefore (1) is equivalent to 

for each e > 0 there exists a number such that 

n > m > N implies \sn — Sm-i\ < (2) 
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Since — Sm-i = J2k=m condition (2) can be rewritten 
for each e > 0 there exists a number such that 

(3) 



n > m > N implies 



k=m 



< e. 



We win usually use version (3) of the Cauchy criterion. 
Theorem 10.11 implies the following. 

14.4 Theorem. 

A series converges if and only if it satisfies the Cauchy criterion. 

14.5 Corollary. 

// a series X^a^ converges, then lima^ = 0. 
Proof 

Since the series converges, (3) in Definition 14.3 holds. In particu- 
lar, (3) in 14.3 holds for n — m] i.e., for each e > 0 there exists a 
number N such that n > N implies |a^| < e. Thus lima^ = 0. ■ 

The converse of Corollary 14.5 does not hold as the example 
^ 1/n = +00 shows. 

We next give several tests to assist us in determining whether a 
series converges. The first test is elementary but useful. 

14.6 Comparison Test. 

Let J2^n be a series where > 0 for all n. 

(i) //X] an converges and < for alln, then ^ converges. 

(ii) If^an — +00 and > for all n, then ^hn — +00. 

Proof 

(i) For n > m we have 

n 



the first inequality follows from the triangle inequality [Ex- 
ercise 3.6(b)]. Since J2^n converges, it satisfies the Cauchy 
criterion 14.3(1). It follows from (1) that also satisfies 

the Cauchy criterion, and hence ^ converges. 
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(ii) Let (sji) and (t^) be the sequences of partial sums for ^ and 
J2^ni respectively. Since > for all n, we obviously have 
tn ^ for all n. Since lims^ = +00, we conclude limt^ = 
+00, i.e., J2bn = ■ 

14.7 Corollary. 

Absolutely convergent series are convergent.^ 
Proof 

Suppose "^bn is absolutely convergent. This means X^a^ converges 
where = for all n. Then < trivially, so ^bn converges 
by 14.6(i). ■ 

We next state the Ratio Test which is popular because it is often 
easy to use. But it has defects: It isn't as general as the Root Test. 
Moreover, an important result concerning the radius of convergence 
of a power series uses the Root Test. Finally, the Ratio Test is worth- 
less if some of the a^'s equal 0. To review lim sup's and liminf's, see 
Definition 10.6, Theorems 10.7 and 11.8, and §12. 

14.8 Ratio Test. 

A series ^ of nonzero terms 

(i) converges absolutely z/ limsup |a^+i/a^| < 1, 
(ii) diverges z/liminf |a^+i/a^| > 1. 

(iii) Otherwise liminf |a^+i/a^| < 1 < limsup |a^+i/a^| and the 
test gives no information. 

We give the proof after the proof of the Root Test. 

Remember that if lim|a^+i/a^| exists, then it is equal to both 
lim sup |a^+i/a^| and liminf |a^+i/a^| and hence the Ratio Test will 
give information unless, of course, the limit lim |a^+i/a^| equals 1. 

14.9 Root Test. 

Let be a series and let a = lim sup la^l-*^/^. The series X^a^ 

(i) converges absolutely if a < 1, 
(ii) diverges if a> 1. 



^As noted in [35], the proofs of this corollary and the Alternating Series 
Theorem 15.3 use the completeness of R. 
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(iii) Otherwise a = 1 and the test gives no information. 
Proof 

(i) Suppose a < 1, and select e > 0 so that a + e < 1. Then by 
Definition 10.6 there is a positive integer N such that 

a - e < sup{|a^|^/'^ : n > N} < a + e. 

In particular, we have la^l-*^/^ < a + e for n > A^, so 

\an\<{a + e)'^ for n>N. 

Since 0 < a + e < 1, the geometric series + con- 

verges and the Comparison Test shows the series X^^jy+i 
also converges. Then clearly ^ converges; see Exercise 14.9. 
(ii) If a > 1, then by Theorem 11.7 a subsequence of la^l-*^/^ has 
limit a > 1. It follows that |a^| > 1 for infinitely many choices 
of n. In particular, the sequence (a^) cannot possibly converge 
to 0, so the series X^^n cannot converge by Corollary 14.5. 
(iii) For each of the series ^ ^ and X] a turns out to equal 1 
as can be seen by applying Theorem 9.7(c) on page 48. 
Since ^ ^ diverges and ^ ^ converges, the equality a = 1 
does not guarantee either convergence or divergence of the 
series. ■ 



Proof of the Ratio Test 

Let a = limsup la^l-*^/^. By Theorem 12.2 we have 



lim inf 



< a < limsup 



(1) 



If limsup \an+i/cin\ < I5 then a < 1 and the series converges by the 
Root Test. If lim inf |a^+i/a^| > 1, then a > 1 and the series diverges 
by the Root Test. Assertion 14. 8 (iii) is verified by again examining 
the series X] 1/n and ^ 1/n^. ■ 

Inequality (1) in the proof of the Ratio Test shows that the Root 
Test is superior to the Ratio Test in the following sense: Whenever 
the Root Test gives no information [i.e., a = 1] the Ratio Test will 
surely also give no information. On the other hand. Example 8 below 
gives a series for which the Ratio Test gives no information but 
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which converges by the Root Test. Nevertheless, the tests usuahy 
fail together as the next remark shows. 



14.10 Remark. 

If the terms are nonzero and if lim|a^+i/a^| = 1, then ol = 
limsup la^l-*^/^ = 1 by Corollary 12.3, so neither the Ratio Test nor 
the Root Test gives information concerning the convergence of ^ a^. 

We have three tests for convergence of a series [Comparison, Ra- 
tio, Root], and we will obtain two more in the next section. There is 
no clearcut strategy advising us which test to try first. However, if 
the form of a given series ^ does not suggest a particular strat- 
egy, and if the ratios a^+i/a^ are easy to calculate, one may as well 
try the Ratio Test first. 

Example 3 

Consider the series 



This is a geometric series and has the form X^^q write it 

as (l/9)E^=o(-V3)''. Here a = 1/9 and r = -1/3, so by (2) of 
Example 1 the sum is (l/9)/[l - (-1/3)] = 1/12. 

The series (1) can also be shown to converge by the Comparison 
Test, since ^1/3^ converges by the Ratio Test or by the Root Test. 
In fact, if an — ( — 1/3)^, then lim |a^+i/a^| = limsup la^l-*^/^ = 1/3. 
Of course, none of these tests will give us the exact value of the 
series (1). □ 

Example 4 

Consider the series 




(1) 




(1) 



If a, 



n 



, then 



2 + 3 



n + 1 



+ 3 



n + 1 



71^ + 3 



a, 



"Yl 



(n + l)2 + 3 



n 



n 
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SO lim |a^+i/a^| = 1. As noted in 14.10, neither the Ratio Test nor 
the Root Test gives any information in this case. Before trying the 
Comparison Test we need to decide whether we believe the series 
converges or not. Since is approximately 1/n for large n and since 
^(1/n) diverges, we expect the series (1) to diverge. Now 

n ^ n n 1 



+ 3 + 4n 

Since ^{l/n) diverges, X](l/4n) also diverges [its partial sums are 
5^/4 where Sn = Ylk=i('^/^)]^ (^) diverges by the Comparison 
Test. □ 



Example 5 

Consider the series 



As the reader should check, neither the Ratio Rest nor the Root Test 
gives any information. The nth term is approximately ^ and in fact 
^^2^ < Since J2 converges, the series (1) converges by the 
Comparison Test. □ 

Example 6 

Consider the series 

If an = then an+i/an = (n + l)/(3n), so lim|a^+i/a^| = 

1/3. Hence the series (1) converges by the Ratio Test. In this case, 
applying the Root Test is not much more difficult provided we recall 
limn-^/^ = 1. It is also possible to show (1) converges by comparing 
it with a suitable geometric series. □ 

Example 7 

Consider the series 



an where a^, 



i-iy 



(1) 



The form of suggests the Root Test. Since la^l-*^/^ = 1 for even 
n and la^l-*^/^ = 1/2 for odd n, we have a = lim sup \an\^^^ = 1. 
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So the Root Test gives no information, and the Ratio Test cannot 
help either. On the other hand, if we had been alert, we would have 
observed = 1 for even n, so (a^) cannot converge to 0. Therefore 
the series (1) diverges by Corollary 14.5. □ 



Example 8 

Consider the series 



n=Q 



^ 11111 

'+4 + 2 + 16 + 8 + 64 + ' 



(1) 



Let an = 2(~-^)''~^. Since < for all n, we can quickly conclude 
the series converges by the Comparison Test. But our real interest in 
this series is that it illustrates the difference between the Ratio Test 
and the Root Test. Since a^+i/a^ = 1/8 for even n and a^+i/a^ = 2 
for odd n, we have 



lim inf 



< 1 < lim sup 



2. 



Hence the Ratio Test gives no information. 

Note that (a^)^/'' = 2n-i for even n and (a^)^/^ = 2"n-i for 
odd n. Since lim2n = lim2~n = 1 by Theorem 9.7(d) on page 48, 
we conclude lim(a^)-'^/^ = |. Therefore a = lim sup (a^)-*^/^ - 



and the series (1) converges by the Root Test. 



< 1 
□ 



Example 9 

Consider the series 



Since lim y/n/{n + 1) = 1, neither the Ratio Test nor the Root Test 
gives any information. Since ^ diverges, we will not be able to 
use the Comparison Test 14.6(i) to show (1) converges. Since the 
terms of the series (1) are not all nonnegative, we will not be able to 
use the Comparison Test 14.6(ii) to show (1) diverges. It turns out 
that this series converges by the Alternating Series Test 15.3 which 
we have deferred to the next section. □ 
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Exercises 

14.1 Determine which of the fohowing series converge. Justify your 
answers. 

c)Ei^ (d)E;#b 

\ \p cos^n \ \pc» 1 

^/ n2 V^/ Z^n=2 logn 

14.2 Repeat Exercise 14.1 for the fohowing. 

a)E^ (b)E(-l)" 

c)E|^ (d)Ef^ 

e)E^ (f)E^ 
g)E|r 

14.3 Repeat Exercise 14.1 for the fohowing. 
a)E^ (b)E2^ 
c) Ew^ (d)E(ir(50+f) 
e)Esin(^) (f)E^ 

14.4 Repeat Exercise 14.1 for the following. 

(a) T,n=2 [n+(-i)n]. (b) E[\/n+l - 

c) E^ 

14.5 Suppose "^an = A and = B where A and 5 are real numbers. 
Use hmit theorems from §9 to quickly prove the following. 

(a) EK + ^n) = ^ + 5. 

(b) = kA for keR. 

(c) Is ^anhn = AB a reasonable conjecture? Discuss. 

14.6 (a) Prove that if ^ \an\ converges and (6^) is a bounded sequence, 

then ^anhn converges. Hint: Use Theorem 14.4. 

(b) Observe that Corollary 14.7 is a special case of part (a). 

14.7 Prove that if ^ is a convergent series of nonnegative numbers and 
p > 1, then Xl<^n converges. 

14.8 Show that if ^ and ^ hn are convergent series of nonnegative 
numbers, then ^ \/ (inbn converges. Hint: Show yj anhn < cin-\-bn for 
all n. 

14.9 The convergence of a series does not depend on any finite number of 
the terms, though of course the value of the limit does. More precisely, 
consider series ^ and ^ bn and suppose the set {n G N : 7^ &n} 
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is finite. Then the series both converge or else they both diverge. 
Prove this. Hint: This is almost obvious from Theorem 14.4. 

14.10 Find a series Xl<^n which diverges by the Root Test but for which 
the Ratio Test gives no information. Compare Example 8. 

14.11 Let {an) be a sequence of nonzero real numbers such that the sequence 
(^^^) of ratios is a constant sequence. Show X^a^ is a geometric 
series. 

14.12 Let (an)nGN be a sequence such that liminf |an| = 0. Prove there is 
a subsequence {ank)ken such that Xlfeli converges. 

14.13 We have seen that it is often a lot harder to find the value of an 
infinite sum than to show it exists. Here are some sums that can be 
handled. 



(a) Calculate EZiilT and Er=i(-|)"- 

(b) Prove J2n=i = ^^=1 kd+i) = 



(c) Prove Y,n=i ^ = \- Hint: Note |^ = ^ - 

(d) Use (c) to calculate Xl^i i^- 

14.14 Prove Xl^i n diverges by comparing with the series Y1^^2 where 
{an) is the sequence 

11111111111111111 

^2' 4' 4' 8' 8' 8' 8' 16' 16' 16' 16' 16' 16' 16' 16' 32' 32'"'^' 
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Sometimes one can check convergence or divergence of series by 
comparing the partial sums with familiar integrals. We illustrate. 

Example 1 

We show J2n^ +00. 

Consider the picture of the function f{x) = ^ in Fig. 15.1. For 
n > 1 it is evident that 




Sum of the areas of the first n rectangles in Fig. 15.1 



k=i 
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y 



I 


\ 


Area I 


















1 

1 2 






Area y 






3 1 
4 










-i 




1 


2 3 4 5 










fix) 


^1 



FIGURE 15.1 



> Area under the curve — between 1 and n + 1 

X 

— dx — logg(n + 1). 

Since lim^^oo loge(^ + 1) = we conclude Yl^=i n 

The series ^ diverges very slowly. In Example 7 on page 120, 
we observe ^^=1 n approximately logg N + 0.5772. Thus for = 
1,000 the sum is approximately 7.485, and for N = 1,000,000 the 
sum is approximately 14.393. □ 




Another proof that ^ - diverges was indicated in Exercise 14.14. 
However, an integral test is useful to establish the next result. 



Example 2 

We show J2 ^ converges. 

Consider the graph of f{x) = \ in Fig. 15.2. Then we have 



n ^ 

^ = Sum of the areas of the first n rectangles 

nn J 



k=l 



<1+ I ^dx = 2--<2 

n 



for all n > 1. Thus the partial sums form an increasing sequence 
that is bounded above by 2. Therefore J2^=i ^ converges and its 
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sum is less than or equal to 2. Actually, we have already mentioned 

2 

[without proof!] that the sum is ^ = 1.6449 • • 

Note that in estimating p" did not simply write 

p- ^ lo ^^^^ though this is true, because this inte- 

gral is infinite. We were after a finite upper bound for the partial 
sums. □ 

The techniques just illustrated can be used to prove the following 
theorem. 



15.1 Theorem. 

^ ^ converges if and only if p > 1. 
Proof 

Supply your own picture and observe that ii p > 1 , then 

^ A;^ ~ Ji xP p-^\ nP-^ J p-l p-l 

Consequently Y.n=i ^ ^ ^ < 

Suppose 0 < p < 1. Then ^ < ^ for all n. Since ^ ^ diverges, 
we see that ^ ^ diverges by the Comparison Test. ■ 



15.2 Integral Tests. 

Here are the conditions under which an integral test is advisable: 

(a) The tests in §14 do not seem to apply. 

(b) The terms of the series ^ are nonnegative. 
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(c) There is a nice decreasing function / on [1, oo) such that f{n) = 
an for ah n [f is decreasing if x < y imphes f{x) > f{y)]. 

(d) The integral of / is easy to calculate or estimate. 

If liuin^^ f (x) dx = +00, then the series will diverge just 
as in Example 1. If liuin^oo Ji f {x) dx < +00, then the series will 
converge just as in Example 2. The interested reader may formulate 
and prove the general result [Exercise 15.8]. □ 

The following result enables us to conclude that series like 
2^ ^ ^ converge even though they do not converge absolutely. See 
Example 9 in §14. 

15.3 Alternating Series Theorem. 

If ai > a2 > ' ' ' > an > • • • > 0 and lim = 0^ then the al- 
ternating series ^(— l)^+-'^a^ converges. Moreover, the partial sums 
= Ylk=ii~^)^^^^k satisfy \s - Sn\ < an for all n. 

The series ^(— l)^a^ is called an alternating series because the 
signs of the terms alternate between + and — . 

Proof 

We need to show that the sequence (5^) converges. Note that the 
subsequence {s2n) is increasing because 52n+2 — = —0,2^+2 + 
<3'2n+i ^ 0. Similarly, the subsequence (52^-1) is decreasing since 

52n+l - S2n-l Ci2n+1 Ci2n < 0. We claim 

S2m < S2n+i for all m, n G N. (1) 

First note that S2n ^ <S2n+i foi" all n, because S2n+i—S2n = Ci2n+i ^ 0. 
If m < n, then (1) holds because 52m ^ <S2n ^ S2n+i- If m > n, 
then (1) holds because S2n+i ^ S2m+i ^ 52m- Thanks to (1), we 
see that {s2n) is an increasing subsequence of (sn) bounded above 
by each odd partial sum, and (52^+1) is a decreasing subsequence 
of (sn) bounded below by each even partial sum. By Theorem 10.2, 
these subsequences converge, say to s and t. Now 

t-s = lim 52n+i - lim S2n lim (52^+1 S2n) lim tt2n+l 0, 

n^oo n^oo n^oo n^oo 

SO 5 = t. It follows that lim„ Sn = s. 
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To check the last claim, note that S2k ^ s < S2k^i, so both 
S2k+i-s and s-S2k are clearly bounded by S2k+i-S2k = o.2k+i < Ci2k' 
So, whether n is even or odd, we have |5 — < a^. ■ 



Exercises 



15.1 Determine which of the following series converge. Justify your 
answers. 

15.2 Repeat Exercise 15.1 for the following. 

(a) E[sin(^r (b) E[sin(^r 

15.3 Show Y!^^2 n(iogn)p couverges if and only if p > 1. 

15.4 Determine which of the following series converge. Justify your 
answers. 

(^) Zln=2 y^logn Zln=2 

(c\ I (c{\ ^og^ 

y-) Z^n=4 n(logn)(loglogn) V^>'Z^n=2 n2 

15.5 Why didn't we use the Comparison Test to prove Theorem 15.1 for 
p>ll 

15.6 (a) Give an example of a divergent series for which J^a^ 

converges. 

(b) Observe that if XI is a convergent series of nonnegative terms, 
then X^a^ also converges. See Exercise 14.7. 

(c) Give an example of a convergent series Yl^n foi" which X^a^ 
diverges. 

15.7 (a) Prove if (a^) is a decreasing sequence of real numbers and if an 

converges, then lim na^ = 0. Hint: Consider |aAr+i +aAr+2H h 

an\ for suitable N. 

(b) Use (a) to give another proof that ^ diverges. 

15.8 Formulate and prove a general integral test as advised in 15.2. 



§16 * Decimal Expansions of Real Numbers 

We begin by recalling the brief discussion of decimals in Discus- 
sion 10.3. There we considered a decimal expansion K.did2ds - - - , 
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where K is a nonnegative integer and each digit dj belongs to 
{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}. This expansion represents the real number 

OO 7 CXO 

which we also can write as 

n 

lim Sn where Sn = K +y dj • 10"-^. 

Thus every such decimal expansion represents a nonnegative real 
number. We will prove the converse after we formalize the process 
of long division. The development here is based on some suggestions 
by Karl Stromberg. 



16.1 Long Division. 

Consider a/h where a and h are positive integers. Since the K term 
above causes no difficulty, we assume a < b. We analyze the familiar 
long division process which gives a decimal expansion for a/b. Fig- 
ure 16.1 shows the first few steps where a = 3 and 6 = 7. If we name 
the digits di, ^3, • • • and the remainders ri, r2, r3, . . ., then so far 
di = 4, (^2 = 2 and ri = 2, r2 = 6. At the next step we divide 7 into 
60 = 10 • r2 and obtain 60 = 7 • 8 + 4. The quotient 8 becomes the 
third digit ds, we place the product 56 under 60, subtract and obtain 
a new remainder 4 = r^. That is, we are calculating the remainder 



.42^3 di=4 d2 = 2 
7| 3.0000 
28 ri =2 

20 

14_ r2 = 6 
60 



FIGURE 16.1 
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obtained by dividing 60 by 7. Next we multiply the remainder r3 = 4 
by 10 and repeat the process. At each stage 

d^G {0,1, 2, 3, 4, 5, 6, 7, 8, 9} 
0 < < 7. 

These results hold for n = 1,2,... if we set tq = 3. In general, we 
set ro = a and obtain 

d„ e {0,1,2,3,4,5,6,7,8,9} (1) 
= 10 ■ rn-i - b-dn (2) 
0<rn<b. (3) 

As we will show, this construction yields: 

6 10 10 6 ^ ^ 

and 

6 ~ 10 10^ 10^ 6 ' ^ ^ 

for n > 2. Since each is less than 6, we have lim^ ~ ^' (^) 

shows 

V Clj 

thus .did2ds' ' ' is a decimal expansion for |. 

Now Eq. (4) follows from ri = 10a — Mi, and we will verify (5) 
by mathematical induction. From (2), we have 

Tn+l = 10rn-bdn+l, SO y = YO T0~6~' 

Substituting this into (5) gives 

6 ~ 10 10^ 10^+1 ^ 10^+1 6 ' ^ ^ 

i.e., (5) holds with n replaced by n + 1. Thus by induction, (5) holds 
for all n. □ 
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16.2 Theorem. 

Every nonnegative real number x has at least one decimal expansion. 
Proof 

It suffices to consider x in [0, 1). The proof will be similar to that for 
results in 16.1, starting with Eqs. (4) and (5) in its proof. We will 
use the "floor function" [ J on R, where [^J is defined to be the 
largest integer less than or equal to ^, for each y G R. 
Since 1 Ox < 10, we can write 

lOx = di + xi where di = [10x\ and xi G [0, 1). (1) 

Note di is in {0, 1, 2, 3, ... , 9} since lOx < 10. Therefore 

di 1 

Suppose, for some n > 1, we have chosen in {0,1,2,3, 

. . . , 9} and xi, . . . , in [0, 1) so that 

di . dn 1 . . 

X — h • • • H Xn. (o) 

10 10^ 10^ ^ ^ 

Since lOxn < 10, we can write 

lOxn = dn+i + Xn+1 whcrc d^+i = [lOx^J , Xn+l G [0, 1). (4) 

Solving for Xn in (4) and substituting the value in (3), we get 

This completes the induction step. Since lim^ lo^+r ^n+i — 0, we 
conclude 

so that .did2ds - • • is a decimal expansion for x. ■ 

As noted in Discussion 10.3, 1.000 • • • and 0.999 • • • are decimal 
expansions for the same real number. That is, the series 



1 + ^0- 10"-^' and ^9-10" 
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have the same value, namely 1. Similarly, 2.75000 • • • and 2.74999 • • • 
are both decimal expansions for ^ [Exercise 16.1]. The next theorem 
shows this is essentially the only way a number can have distinct 
decimal expansions. 



16.3 Theorem. 

A real number x has exactly one decimal expansion or else x has two 
decimal expansions, one ending in a sequence of all 0 ^s and the other 
ending in a sequence of all 9 ^s. 

Proof 

We assume x > 0. If x has decimal expansion K.OOO • • • with K > 0, 
then it has one other decimal expansion, namely {K — 1).999 • • •. If 
X has decimal expansion K.did2ds • • • drOOO • • • where 7^ 0, then it 
has one other decimal expansion K.did2ds • • • {dr — 1)9999 • • •. The 
reader can easily check these claims [Exercise 16.2]. 

Now suppose X has two distinct decimal expansions K.did2ds • • • 
and L. 616263 • • •. Suppose K < L.li any dj < 9, then by Exercise 16.3 
we have 

00 

X <K + J2^' lO""^ =K + l<L<x, 

a contradiction. It follows that x = K + 1 = L and its decimal 
expansions are i^.999 • • • and {K + 1).000 • • •. In the remaining case, 
we have K = L. Let 



m = min{j : dj ^ ej}. 



We may assume dm < If dj < 9 for any j > m, then by 
Exercise 16.3, 

m 00 m 

x<K + ^dj- 10-^ + J] 9 • 10-^' = K + "^dj- 10-^ + 10-^ 

j=l j=m-\-l j=l 

m—1 m 

= K 10"^ + (^rn ■ 10"'" + 10"™ <K + J2ej- 10"^' < X, 

i=i i=i 
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a contradiction. Thus dj = 9 for j > m. Likewise, if ej > 0 for any 
j > m, then 

m m—1 

x> K + J2(^j- 10"^ =K+^dj- 10-^ + em ■ 10-"" 
j=i j=i 

m—1 

> K + ■ 10-^' + dm ■ 10"™ + 10"'" 

i=i 

m oo 

= K + ^ d^- . 10-^' + X! 9 • 10-^' > X, 

j=l j=m+l 

a contradiction. So in this case, dj = 9 for j > m, = + 1 and 
ej = 0 for j > m. ■ 

16.4 Definition. 

An expression of the form 

K.did2 ' ' ' didi^i ' ' ' di^r 

represents the decimal expansion in which the block d^^i • • • d^^^ is 
repeated indefinitely: 

K.did2 ' ' ' didi^i • • • di^rdi^i ' ' ' di^rdi^i ' ' ' di^rdi^i ' ' ' di^r ' ' ' • 
We call such an expansion a repeating decimal. 

Example 1 

Every integer is a repeating decimal. For example, 17 
17.000 • • •. Another simple example is 

.8 = .888... = y8.10-^ = AyiO-^-^ 

^ 10^ 10 9 

Example 2 

The expression 3.967 represents the repeating decimal 3.9676767 • • •. 
We evaluate this as follows: 

3.967 = 3 + 9 • 10"^ + 6 • 10"^ + 7 • 10"^ + 6 • 10"^ + 7 • 10"^ + • • • 

oo 

= 3 + 9 ■ 10"^ + 67 • 10"^ J](10-2y 

j=0 
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= 3 + 9.10-+67.10-fl5?)=3+|- + |I, 

V 99 y 10 990 

_ 3,928 _ 1,964 
~ 990 ~ 495 

Thus the repeating decimal 3.967 represents the rational number 
Any repeating decimal can be evaluated as a rational number 
in this way, as we'll show in the next theorem. □ 

Example 3 

We find the decimal expansion for ^. By the usual long division 
process in 16.1, we find 

— = 1.571428571428571428571428571428571 • • • , 
7 

i.e., ^ = 1.571428. To check this, observe 

^ f:7i 428 

1.571428 = 1 + 571, 428 • 10"*^ ^(10-*^^ = 1 + ^r^r^r^ 

^ 999,999 

i=o 

. 4 11 

= ^ + 7 = y □ 

Many books give the next theorem as an exercise, probably to 
avoid the complicated notation. If the details seem too complicated 
to you, move on to Examples 4-7. 

16.5 Theorem. 

A real number x is rational if and only if its decimal expansion is 
repeating. [Theorem 16.3 shows that if x has two decimal expansions, 
they are both repeating.] 

Proof 

First assume x > 0 has a repeating decimal expansion x = 
K.did2 • • • dj^di^i • • • di^r- Then 

£ 

where 



y = -di^i ' ' ' di^r, 
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SO it suffices to show y is rational. To simphfy the notation, we write 



y = .6162 "'6r. 



A httle computation shows 



J]e,.10-^- 



CXO 

E 

3=0 



(10- 



10^ 



10^ 



Thus ^ is rational. In fact, if we write eie2 • • • for the usual decimal 
X]j=o ^3 ' lO^""^""^ "f^ot the product, then y = ^jflzif^; see Example 3. 

Next consider any positive rational, say | where a,6 G N. We 
may assume a < 6. As we saw in 16.1, | is given by the decimal 
expansion .^1(^2^3 • • • where ro = a. 



4 e {0,1,2,3,4,5,6,7,8,9} 
r/o = 10 • rfc-i - ci/c6 
0<rk<b, 



(1) 
(2) 
(3) 



for k > 1. Since a and 6 are integers, each is an integer. Thus (3) 
can be written 



rfc e {0,1,2, ...,6-1} for A; > 0. 



(4) 



This set has b elements, so the first 6+1 remainders rk cannot all 
be distinct. That is, there exist integers m > 0 and p > 0 so that 



0<m<m+p<b and = 



From the construction giving (l)-(3) it is clear that given rk-i^ the 
integers rk and dk are uniquely determined. Thus 



rk implies r^+i = r^+i and d^+i^d^+i. 



Since r^+p, we conclude r^+i = r^+i+p and d^+i = ^m+i+i?. 

A simple induction shows that the statement 

''rk = rk+p and dk = 

holds for all integers k > m + 1. Thus the decimal expansion of | is 
periodic with period p after the first m digits. That is, 

- — .did2 ' ' ' dmdm^i ' ' ' dm^p. 
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Remark. Given Vk-i^ the uniqueness of and follows from 
the so-called "division algorithm," which is actually a theorem that 
shows the algorithm for division never breaks down. It says that if 
6 is a positive integer and m G Z, then there are unique integers q 
and r so that 

m — hq^r and 0 < r < 6; 

q is called the quotient and r is called the remainder. With m — 
10 • Tk-i in Theorem 16.5, this yields 

10 • Tk-i —hq^r where 0 < r < 6. 

If we name q = dk and r = rk, then we obtain formula (2) in 
Theorem 16.5. For more details, see for example, [60, §3.5]. 

Example 4 

An expansion such as 

.101001000100001000001000000100000001000000001000000000100- • • 

represents an irrational number, since it cannot be a repeating 
decimal: we've arranged for arbitrarily long blocks of O's. □ 

Example 5 

We do not know the complete decimal expansions of \/2, \/3 and 
many other familiar irrational numbers, but we know that they 
cannot be repeating by virtue of the last theorem. □ 

Example 6 

We have claimed tt and e are irrational. These facts and many others 
are proved in a fascinating book by Ivan Niven [49]. 
(a) Here is a proof that 




k=0 



and {b+iy..j:ltlh. 



is irrational. Assume e 



= f where a, 6 G N. Then both (6+1)! -e 
must be integers, so the difference 




k=b+2 
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must be a positive integer. On the other hand, this last number 
is less than 

11 1 6T2 1 , 



6 + 2 (6 + 2)2 (6 + 2)3 l-^ b+1 

a contradiction. 

(b) We will prove tt^ is irrational, from which the irrationality of 
TT follows; see Exercise 16.10. 

The key to the proof that tt^ is irrational is the sequence of 
integrals In = Jq sin x dx. Thus 



In = Pn{x) sin xdx where Pn{x) 
Jo 



{x{7T — x)y 



Claim 1. There is a sequence {Qn)'^=o of polynomials with 
integer coefficients, of degree at most n, satisfying In = Qn(^^) 
for all n. 

Proof. First, we obtain a recursive relation for see (3). 
We use integration by parts (Theorem 34.2) twice to show 

In = Pn{x) sin X dx = — / P^{x)sinxdx for n>l. 
Jo Jo 

(1) 

In fact, 

/ Pn(a:^) sin xdx = [—Pn (vr) cos(7r) + Pn (0) cos(O)] + / P^(x)cosxdx 
Jo Jo 

— I P^(x) cosx dx, 

since Pn{x) contains a factor of x(7r — x) which is 0 at both tt 
and 0. Therefore 

In = P^{x)cOSxdx 

Jo 

= [Pn{7v) sin(7r) - P^{0) sin(O)] - / P^^ix) sin x dx 

Jo 

= — / P^{x)sinxdx, 
Jo 
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and (1) holds. For n > 2, we have 

Pni^) = ^^^^^^^yr-^ - 2^) = Pn-i{x){n - 2x), 
so, using this for n — 1 and the product rule, we have 

= Pn-2{x){7r - 2xf + Pn-l{x){-2) 

= n'^Pn-2{x) + Pn-2{x){-4.TTX + Ax^) - 2Pn-l{x). 

Since 

P„_2(x)(-47rx + 4x2) = -4.M!L_l^)!:i = -4.P„_i(x)(n-l), 

we conclude 

Pl[{x) = 7r2p,_2(x) - [4(n - 1) + 2]P„_i(x). 
Therefore 

P';{x)=^^Pn-2{x)-{^n-2)Pn-i{x) for n>2. (2) 

To prove Claim 1, note that /q = 2 is clear. Using (1) and 
Pi{x) = —2, we see that Ii = 4. And from (1) and (2), we see 
that 

= -^2j^_2 + (4n - 2)/^_i for n > 2. (3) 

Now Claim 1 holds by a simple induction argument, where 
Qo = 2, Qi = 4, and 

Qn{x) = -xQn-2{x) + (4n - 2)Qn-i{x) for n > 2. 
Claim 2. TT^ is irrational. 

Proof. Suppose tt^ = a/b. Using Claim 1, we see that 
each b^In = b^Qn{a/b) is an integer. Since x{7t — x) takes its 
maximum at 7r/2, we can write 

(x(7T — x))^ . 

i sm X ax 



0 < b'^In = 6^ 
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As noted in Exercise 9.15, the right-hand side converges to 0. 
So, for large n, the integer 6^/^ hes in the interval (0,1), a 
contradiction. 

This simplification of Ivan Niven's famous short proof 
(1947) is due to Zhou and Markov [72]. Zhou and Markov use a 
similar technique to prove tan r is irrational for nonzero ratio- 
nal r and cos r is irrational if is a nonzero rational. Compare 
with results in Niven's book [49, Chap. 2]. 
(c) It is even more difficult to prove tt and e are not algebraic 
numbers; see Definition 2.1. These results are proved in Niven's 
book [49, Theorems 2.12 and 9.11]. □ 

Example 7 

There is a famous number introduced by Euler over 200 years ago 
that arises in the study of the gamma function. It is known as Euler^s 
constant and is defined by 

■ n ^ 

J^^-loge^ • 

.k=l 

Even though 

n ^ 

lim y — — +OC and lim logg n — +00, 

k=l 

the limit defining 7 exists and is finite [Exercise 16.9]. In fact, 7 
is approximately 0.577216. The amazing fact is that no one knows 
whether 7 is rational or not. Most mathematicians believe 7 is irra- 
tional. This is because it is "easier" for a number to be irrational, 
since repeating decimal expansions are regular. The remark in Ex- 
ercise 16.8 hints at another reason it is easier for a number to be 
irrational. □ 

Exercises 

16.1 (a) Show 2.749 and 2.750 are both decimal expansions for 

(b) Which of these expansions arises from the long division process 
described in 16.1? 



7 = lim 
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16.2 Verify the claims in the first paragraph of the proof of Theorem 16.3. 

16.3 Suppose Yl and Yl are convergent series of nonnegative num- 
bers. Show that if < bn for all n and if < bn for at least one n, 
then < E^n- 

16.4 Write the following repeating decimals as rationals, i.e., as fractions 
of integers. 

(a) .2_ (b) .02_ 

(c) .02 (d) 3. T4 

(e) .10 (f) .1492 

16.5 Find the decimal expansions of the following rational numbers, 
(a) 1/8 (b) 1/16 

(c) 2/3 (d) 7/9 

(e) 6/11 (f) 22/7 

16.6 Find the decimal expansions of |, |, |, | and |. Note the 
interesting pattern. 

16.7 Is .1234567891011121314151617181920212223242526- •• rational? 

16.8 Let {sn) be a sequence of numbers in (0, 1). Each Sn has a decimal 
expansion {) A^^^ d2^^ d^^^ • • •. For each n, let = 6 if d^n^ ^ 6 and 

= 7 if d^^ = 6. Show .616263 •• • is the decimal expansion for 
some number y in (0, 1) and y ^ Sn for all n. Remark: This shows 
the elements of (0,1) cannot be listed as a sequence. In set-theoretic 
parlance, (0, 1) is "uncountable." Since the set Qfl (0, 1) can be listed 
as a sequence, there are a lot of irrational numbers in (0, 1)! 

16.9 Let 7. = (ELi \) - loge n = ELi \ ' Ii jdi. 

(a) Show (7n) is a decreasing sequence. Hint: Look at 7^ — 7n+i- 

(b) Show 0 < 7n < 1 for all n. 

(c) Observe that 7 = lim^ 7n exists and is finite. 

16.10 In Example 6(b), we showed tt^ is irrational. Use this to show tt is 
irrational. What can you say about ^/7^ and ^7 ii^l 
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CHAPTER 



Continuity 



Most of the calculus involves the study of continuous functions. 
In this chapter we study continuous and uniformly continuous 
functions. 

§17 Continuous Functions 

Recall that the salient features of a function / are: 

(a) The set on which / is defined, called the domain of f and 
written dom(/); 

(b) The assignment, rule or formula specifying the value f{x) of / 
at each x in dom(/). 

We will be concerned with functions / such that dom(/) C R 
and such that / is a real-valued function, i.e., /(x) G R for all 
X G dom(/). Properly speaking, the symbol / represents the function 
while f{x) represents the value of the function at x. However, a func- 
tion is often given by specifying its values and without mentioning its 
domain. In this case, the domain is understood to be the natural do- 
main: the largest subset of R on which the function is a well defined 

K.A. Ross, Elementary Analysis: The Theory of Calculus, 123 
Undergraduate Texts in Mathematics, DOI 10.1007/978-l-4614-6271-2_3, 
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real-valued function. Thus "the function f{x) = ^" is shorthand for 
"the function / given by f{x) = ^ with natural domain {x G M : 
X 0}." Similarly, the natural domain of g{x) = a/4 — is [—2,2] 
and the natural domain of cscx = is the set of real numbers x 
not of the form nvr, n G Z. 

In keeping with the approach in this book, we will define continu- 
ity in terms of sequences. We then show our definition is equivalent 
to the usual e-6 definition. 

17.1 Definition. 

Let / be a real- valued function whose domain is a subset of M. The 
function / is continuous at xq in dom(/) if, for every sequence (x^) 
in dom(/) converging to xq, we have lim^/(x^) = f{xo). If / is 
continuous at each point of a set 5 C dom(/), then / is said to 
be continuous on S. The function / is said to be continuous if it is 
continuous on dom(/). 

Our definition implies that the values f{x) are close to /{xq) 
when the values x are close to xq. The next theorem says this in 
another way. In fact, condition (1) of the next theorem is the e-6 
definition of continuity given in many calculus books. 

17.2 Theorem. 

Let f be a real-valued function whose domain is a subset o/R. Then 
f is continuous at xq in dom(/) if and only if 

for each e > 0 there exists 6 > 0 such that 
X G dom(/) and \x — xq] < 6 imply \f{x) — /(xo)| < e. 

(1) 

Proof 

Suppose (1) holds, and consider a sequence (x^) in dom(/) such that 
limx^ = Xq. We need to prove lim/(x^) = f{xo). Let e > 0. By (1), 
there exists 6 > 0 such that 

X G dom(/) and \x — xq\ < 6 imply \f{x) — /(xo)| < e. 

Since limx^ = xq, there exists N so that 

n > N implies |x^ — xo| < 5. 
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It follows that 

n > implies \f{xn)-f{xo)\<e. 

This proves lim/(x^) = /{xq). 

Now assume / is continuous at xq, but (1) fails. Then there exists 
e > 0 so that the implication 

"x G dom(/) and \x — xq\ < 6 imply \f{x) — /{xq)] < e" 

fails for each 5 > 0. In particular, the implication 

"x G dom(/) and |x — xqI < — imply \f{x) — /(xo)| < e" 

n 

fails for each n G N. So for each n G N there exists Xn in dom(/) such 
that — xo| < ^ and yet \ f{xo) — f{xn)\ > e. Thus we have lim = 
xo, but we cannot have lim/(x^) = /(xq) since |/(xo) — f{xn)\ > e 
for all n. This shows / cannot be continuous at xq, contrary to our 
assumption. ■ 

As the next example illustrates, it is sometimes easier to work 
with the sequential definition of continuity in Definition 17.1 than 
the e-5 property in Theorem 17.2. However, it is important to get 
comfortable with the e-6 property, partly because the definition of 
uniform continuity is more closely related to the e-6 property than 
the sequential definition. 

Example 1 

Let f{x) = 2x^ + 1 for X G R. Prove / is continuous on R by 

(a) Using the definition, 

(b) Using the e-6 property of Theorem 17.2. 

Solution 

(a) Suppose limx^ = xq. Then we have 

lim/(x^) lim[2x^ + 1] = 2[limx^]^ + 1 = 2xo + 1 = /(xq) 

where the second equality is an application of the limit 
Theorems 9.2-9.4. Hence / is continuous at each xq in R. 

(b) Let Xq be in R and let e > 0. We want to show \f{x) — f{xQ)\ < e 
provided |x — xo| is sufficiently small, i.e., less than some 6. We 
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observe 

\f{x) - f{xo)\ = \2x^ + 1 - {2x1 + 1)1 = |2^' - 2xol 
= 2\x — xo\ • \x + xo\. 

We need to get a bound for |x + xo| that does not depend on x. 
We notice that if |x — xo| < 1, say, then \x\ < |xo| + l and hence 
1^ + xo\ < \x\ + |xo| < 2|xo| + 1. Thus we have 

|/(x)-/(xo)| <2|x-xo|(2|xo| + l) 
provided \x — xo\ < 1. To arrange for 2\x — xo\{2\xo\ + 1) < e, 
it suffices to have |x — xo| < 2(2|xo|+i) ^^^^ |^ — ^o| < 1- So 
we put 

5 = min < 1 , — — — ■ — > . 

1 '2(2|xo| + l)J 

The work above shows |x — xo| < S implies \f{x) — f{xo)\ < e, 
as desired. □ 

The reason that solution (a) in Example 1 is so much easier is 
that the careful analysis was done in proving the limit theorems in §9. 

Example 2 

Let f{x) = x^sin(^) for x 7^ 0 and /(O) = 0. The graph of / 
in Fig. 17.1 looks continuous. Prove / is continuous at 0. 

Solution 

Let e > 0. Clearly \f{x) - /(0)| = \f{x)\ < x^ for ah X. Since we 
want this to be less than e, we set 6 = y/e. Then |x — 0| < 5 implies 

x'^ < 6'^ = e, so 

\x-0\<6 implies - /(0)| < e. 

Hence the e-S property holds and / is continuous at 0. □ 

In Example 2 it would have been equally easy to show that if 
limx^ = 0 then lim/(x^) = 0. The function / in Example 2 is also 
continuous at the other points of R; see Example 4. 

Example 3 

Let f{x) = ^ sin(^) for x ^ 0 and /(O) = 0. Show / is discontinuous^ 
i.e., not continuous, at 0. 
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y 




X 



FIGURE 17.1 

Solution 

It suffices for us to find a sequence (xn) converging to 0 such 
that f{xn) does not converge to /(O) = 0. So we will arrange 
for — sin(^) — — where Xn 0. Thus we want sin(^) — 1, 

^ 27rn + |, = 27rn+f ^2ln^^ ' ^^^^ hm 0 while 

lim j[xn) = lim ^ = +00. □ 



Let / be a real-valued function. For k in R, kj signifies the func- 
tion defined by {kf){x) = kf{x) for x G dom(/). Also |/| is the 
function defined by \f\{x) = \f{x) \ for x G dom(/). Thus if / is given 
by f{x) = \/x — 4 for X > 0, then 3/ is given by (3/)(x) = Z^/x — 12 
for X > 0, and |/| is given by = |\/^~ 4| for x > 0. Here is an 

easy theorem. 
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17.3 Theorem. 

Let f be a real-valued function with dom(/) C R. // / is continuous 
at xq in dom(/)^ then \ f\ and kf , G are continuous at xq. 

Proof 

Consider a sequence (x^) in dom(/) converging to xq. Since / is 
continuous at xq, we have lim/(x^) = f{xo). Theorem 9.2 shows 
limkf{xn) — kf{xQ). This proves kf is continuous at xq. 

To prove |/| is continuous at xq, we need to prove hm \f{xn)\ = 
|/(xo)|. This fohows from the inequahty 

||/(^n)|-|/MI|<|/(:r„)-/(xo)|; (1) 

see Exercise 3.5. [In detail, consider e > 0. Since hm/(x^) = /(xq), 
there exists such that n > N imphes \f{xn) — f{xo)\ < e. So 
by (1), 

n> N imphes - \f{xo)\\ < e; 

thus hm \f{xn)\ = |/(^o)|.] ■ 

We remind readers that if / and g are real- valued functions, then 
we can combine / and g to obtain new functions: 

(/ + 9){x) = f{x) + g{x)] fg{x) = f{x)g{x)] 

(f/9)(^)-W)'^ ^o/(x)=^(/(x)); 
max(/,^)(x) = max{/(x),^(x)}; min(/,^)(x) = mm{f{x), g{x)} 

The function go f is called the composition of g and f . Each of these 
new functions is defined exactly where they make sense. Thus the 
domains of / + ^, max(/, g) and min(/, g) are dom(/) H dom(^), 
the domain of f /g is the set dom(/) H {x G dom(^) : g{x) ^ 0}, 
and the domain of ^ o / is {x G dom(/) : /(x) G dom(^)}. Note 
f + 9 = 9 + f and fg = gf but that in general f og ^ go f. 

These new functions are continuous if / and g are continuous. 

17.4 Theorem. 

Let f and g be real-valued functions that are continuous at xq in R. 
Then 

(i) f + g is continuous at xq; 
(ii) fg is continuous at xq; 
(iii) f /g is continuous at xq if g{xo) ^ 0. 
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Proof 

We are given that xq G dom(/) H dom(^). Let (xn) be a sequence in 
dom(/) ndom(^) converging to xq. Then we have hm/(x^) = f{xo) 
and \im g{xn) = g{xo). Theorem 9.3 shows 

hm(/ + g){xn) = lim[f{xn) + g{xn)] = hm f{xn) + hm^(x^) 
= /(^o) + ^(^o) = (/ + 9){xo), 

so f + g is continuous at xq. Likewise, Theorem 9.4 imphes fg is 
continuous at xq. 

To handle f / g we assume g{xo) ^ 0 and consider a sequence 
[xn) in dom(/) Pi {x G dom(^) : g[x^ ^ 0} converging to xq. Then 
Theorem 9.6 shows 

SO f / g is continuous at xq. ■ 



17.5 Theorem. 

// / is continuous at and g is continuous at f{xo), then the 
composite function g o f is continuous at xq. 

Proof 

We are given that xq G dom(/) and /{xq) G dom(^). Let (xn) be a 
sequence in {x G dom(/) : /(x) G dom(^)} converging to xq. Since / 
is continuous at xq, we have hm/(x^) = /(xq). Since the sequence 
(/(x^)) converges to /(xq) and g is continuous at /(xq), we also have 
lim^(/(x^)) = g{f{xo))] that is, lim^o/(x^) = gof{xo). Hence gof 
is continuous at xq. ■ 



Example 4 

For this example, let us accept as known that polynomial functions 
and the functions sinx, cosx and are continuous on R. Then 
4e^ and | sinx| are continuous on R by Theorem 17.3. The function 
sinx + 4e^ + x^ is continuous on R by (i) of Theorem 17.4. The 
function x^sinx is continuous on R by (ii) of Theorem 17.4, and 
(iii) of Theorem 17.4 shows tanx = is continuous wherever 

V ^ cos X 

cosx ^ 0, i.e., at all x not of the form nvr + |, n G Z. Theorem 17.5 
tells us e^^^^ and cos(e^) are continuous on R; for example, cos(e^) = 
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g o f(x) where f{x) = and g{x) = cosx. Several applications of 
Theorems 17.3-17.5 will show sin(-) and - sin( A-) are continuous 
at all nonzero x in R. □ 



Example 5 

Let / and g be continuous at xq in R. Prove max(/, g) is continuous 

at Xq. □ 

Solution 

We could prove this using Definition 17.1 or the e-6 condition in 
Theorem 17.2. However, we illustrate a useful technique by reducing 
the problem to results we have already established. First, observe 

1 1 

max(/,^) = ^{f + g) + ^\f - 

which shows that the function max(/, ^) is a combination of func- 
tions to which our theorems apply. This equation holds because 
max{a, 6} = ^(a + 6) + — 6| is true for all a, 6 G R, a fact which 
is easily checked by considering the cases a > b and a < b. By The- 
orem 17.4(i), f + g and f — g are continuous at xq. Hence \f — g\ 
is continuous at xq by Theorem 17.3. Then ^{f + g) and ^\f — g\ 
are continuous at xq by Theorem 17.3, and another application of 
Theorem 17.4(i) shows max(/, ^) is continuous at xq. □ 



Exercises 

17.1 Let f{x) = y^4: — X for X < 4 and g{x) = x'^ for all x G M. 

(a) Give the domains of / + ^, fg^ f ^ g and g o f. 

(b) Findthe values /og(0), 50/(0), / o g o /(I), fog{2) and 
50/(2). 

(c) Are the functions fog and g o f equal? 

(d) Are f o g(3) and g o f{3) meaningful? 

17.2 Let f{x) = 4 for X > 0, f{x) = 0 for x < 0, and g{x) = x'^ for all x. 
Thus dom(/) dom(^) M. 

(a) Determine the following functions: f ^ g, fg, f o g^ g o f . Be 
sure to specify their domains. 

(b) Which of the functions /, g^ f ^g-, fg-, f ^g^ g^ f is continuous? 



Exercises ]^31 



17.3 Accept on faith that the fohowing famihar functions are continuous 
on their domains: sinx, cosx, e^, 2^, \og^x for x > 0, for x > 0 
[p any real number] . Use these facts and theorems in this section to 
prove the fohowing functions are also continuous. 

(a) logg(l + cos^ x) 

(b) [sin^ X + cos^ x]^ 

(c) 2-^ 

(d) 8^ 

(e) tanx for x ^ odd multiple of ^ 

(f) xsin(^) for X 7^ 0 

(g) x^sm{^) for X 7^ 0 

(h) ^sin(^) for X 7^0 

17.4 Prove the function ^/x is continuous on its domain [0,oc). Hint: 
Apply Example 5 in §8. 

17.5 (a) Prove that if m G N, then the function f{x) = x^ is continuous 

on M. 

(b) Prove every polynomial function p{x) = ao + aix + • • • + anX^ 
is continuous on M. 

17.6 A rational function is a function / of the form p/q where p and q are 
polynomial functions. The domain of / is {x G M : q{x) ^ 0}. Prove 
every rational function is continuous. Hint'. Use Exercise 17.5. 

17.7 (a) Observe that if /c G M, then the function g{x) = kx is continuous 

by Exercise 17.5. 

(b) Prove \x\ is a continuous function on M. 

(c) Use (a) and (b) and Theorem 17.5 to give another proof of 
Theorem 17.3. 

17.8 Let / and g be real-valued functions. 

(a) Showmin(/,^) = i(/ + ^)-i|/-^|. 

(b) Show min(/, g) = - max(-/, -g). 

(c) Use (a) or (b) to prove that if / and g are continuous at xq in 
M, then mm{f^g) is continuous at xq. 
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17.9 Prove each of the fohowing functions in continuous at xq by verifying 
the e-S property of Theorem 17.2. 

(a) f{x) xo 2; 

(b) f{x) = Xo = 0; 

(c) f{x) = xsin(^) for X 7^ 0 and /(O) = 0, = 0; 

(d) g{x) = x^, Xo arbitrary. 

Hint for (d): x^ — Xq = {x — xo){x'^ + xqx + Xq). 

17.10 Prove the fohowing functions are discontinuous at the indicated 
points. You may use either Definition 17.1 or the e-6 property in 
Theorem 17.2. 

(a) f{x) = 1 for X > 0 and f{x) = 0 for x < 0, = 0; 

(b) g{x) = sin(^) for X 7^ 0 and ^(0) = 0, = 0; 

(c) sgn(x) = —1 for X < 0, sgn(x) = 1 for x > 0, and sgn(O) = 0, 
xq = 0. The function sgn is cahed the signum function] note 
sgn(x) = ^ for X 7^ 0. 

17.11 Let / be a real- valued function with dom(/) C M. Prove / is con- 
tinuous at xq if and only if, for every monotonic sequence (x^) in 
dom(/) converging to xq, we have lim/(xn) = f{xo)' Hint: Don't 
forget Theorem 11.4. 

17.12 (a) Let / be a continuous real- valued function with domain (a, 6). 

Show that if /(r) = 0 for each rational number r in (a, 6), then 
/(x) = 0 for all X G (a, 6). 

(b) Let / and g be continuous real- valued functions on (a, b) such 
that /(r) = g{r) for each rational number r in (a, 6). Prove 
/(x) = g{x) for all x G (a, 6). Hint: Use part (a). 

17.13 (a) Let /(x) = 1 for rational numbers x and /(x) = 0 for irrational 

numbers. Show / is discontinuous at every x in M. 

(b) Let h{x) = X for rational numbers x and h{x) = 0 for irrational 
numbers. Show h is continuous at x = 0 and at no other point. 

17.14 For each nonzero rational number x, write x as | where p^q are 
integers with no common factors and g > 0, and then define /(x) = 
^. Also define /(O) = 1 and /(x) = 0 for all x G M\Q. Thus /(x) = 1 

for each integer, /(^) = /(— ^) = /(§) = ' " ' = etc. Show / is 
continuous at each point of M \ Q and discontinuous at each point 
of Q. 
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17.15 Let / be a real-valued function whose domain is a subset of R. Show 
/ is continuous at xq in dom(/) if and only if, for every sequence 
(xn) in dom(/) \ {xq} converging to xq^ we have \imf{xn) = /(^o)- 

17.16 The postage-stamp function P is defined by P{x) = Afoi 0 < x < 1 
and P{x) = A -\- Bn for n < x < n -\- 1. The definition of P means 
that P takes the value A on the interval [0, 1), the value A-\- B on 
the interval [1,2), the value A + 2B on the interval [2, 3), etc. Here 
A is postage needed for the first ounce, and B is the postage needed 
for each additional ounce. Show P is discontinuous at every positive 
integer. Because postage rates tend to increase over time, A and B 
are actually functions. 



§18 Properties of Continuous Functions 

A real-valued function / is said to be bounded if {f{x) : x G dom(/)} 
is a bounded set, i.e., if there exists a real number M such that 
\f{x)\ < M for all x G dom(/). 

18.1 Theorem. 

Let f be a continuous real-valued function on a closed interval [a, 6]. 
Then f is a bounded function. Moreover, f assumes its maximum 
and minimum values on [a, 6]; that is, there exist xq^z/q in [a, 6] such 
that /(xo) < f{x) < f{yo) for all x G [a, 6]. 

Proof 

Assume / is not bounded on [a, 6]. Then to each n G N there 
corresponds an Xn G [a, 6] such that \f{xn)\ > n. By the Bolzano- 
Weierstrass Theorem 11.5, (x^) has a subsequence (x^^) that 
converges to some real number xq. The number also must be- 
long to the closed interval [a, 6], as noted in Exercise 8.9. Since / is 
continuous at xq, we have limj^^^ fi^uk) — /(^o)? but we also have 
lim/^^oo \f{xnk)\ = +00, which is a contradiction. It follows that / is 
bounded. 

Now let M = sup{/(x) : x G [a, 6]}; M is finite by the preced- 
ing paragraph. For each n G N there exists i/n G [a, b] such that 
^ - ^ < fiVn) < M. Hence we have lim/(^^) = M. By the 
Bolzano- Weierstrass theorem, there is a subsequence {yuk) of {Vn) 
converging to a limit in [a^b]. Since / is continuous at ?/o, we 
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have f{yo) = hm^^oo /(^/nj- Since {f{ynk))keN is a subsequence of 
(/(2/n))nGN, Theorem 11.3 shows hm^^oo /(^/nj = hm^^oo = 
M and therefore f{yo) = M. Thus / assumes its maximum at yo. 

The last paragraph apphes to the function — /, so — / assumes 
its maximum at some xq G [a, 6]. It follows easily that / assumes its 
minimum at xq; see Exercise 18.1. ■ 

Theorem 18.1 is used all the time, at least implicitly, in solv- 
ing maximum-minimum problems in calculus because it is taken for 
granted that the problems have solutions, namely that a continuous 
function on a closed interval actually takes on a maximum and a 
minimum. If the domain is not a closed interval, one needs to be 
careful; see Exercise 18.3. 

Theorem 18.1 is false if the closed interval [a, b] is replaced by an 
open interval. For example, f{x) = ^ is continuous but unbounded 
on (0, 1). The function x^ is continuous and bounded on (—1,1), but 
it does not have a maximum value on (—1,1). 

18.2 Intermediate Value Theorem. 

If f is a continuous real- valued function on an interval I, then f has 
the intermediate value property on I: Whenever a^b ^ I , a < b and y 
lies between f (a) and f{b) [i.e., f{a) <y < f{b) or f{b) <y < f{ci)\, 
there exists at least one x in (a^b) such that f{x) = y. 

Proof 

We assume /(a) < y < f{b); the other case is similar. Let S = 
{x G [a, 6] : f{x) < y}; see Fig. 18.1. Since a belongs to 5, the set 
S is nonempty, so xq = sup S represents a number in [a, b]. For each 
n G N, xo — - is not an upper bound for 5, so there exists Sn ^ S 
such that Xq — < Sn < Xq- Thus lim 5^ = Xq and, since f{sn) < y 
for all n, we have 

f{xo) = limf{sn)<y. (1) 

Let tn = min{6, xo + ^}. Since xq <tn < xo + ^ we have limt^ = xq. 
Each tji belongs to [a, b] but not to S, so f{tn) > y for all n. Therefore 
we have 



/(xo) = lim f{tn) > y] 
this and (1) imply /(xq) = y. 
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18.3 Corollary. 

If f is a continuous real-valued function on an interval I, then the 
set f{I) = {f{x) : X ^ 1} is also an interval or a single point. 

Proof 

The set J = f{I) has the property: 

2/0, yi ^ J and yo <y < yi imply y e J. (1) 

If inf J < sup J, then such a set J will be an interval. In fact, we will 
show 

inf J < y < sup J implies y ^ J, (2) 

so J is an interval with endpoints inf J and sup J; inf J and sup J 
may or may not belong to J and they may or may not be finite. 

To prove (2) from (1), consider inf J < y < sup J. Then there 
exist yo^ yi in J so that yo < y < yi. Thus ^ G J by (1). ■ 



Example 1 

Let / be a continuous function mapping [0,1] into [0,1]. In other 
words, dom(/) = [0, 1] and f{x) G [0, 1] for all x G [0, 1]. Show / has 
a fixed pointy i.e., a point xq G [0, 1] such that f{xo) = xq; xq is left 
"fixed" by /. □ 




Solution 

The graph of / hes in the unit square; see Fig. 18.2. Our assertion 
is equivalent to the assertion that the graph of / crosses the y = x 
hne, which is almost obvious. 

A rigorous proof involves a little trick. Consider g{x) — f{x) — x 
which is also a continuous function on [0, 1]. Since ^(0) = /(O) — 0 = 
/(O) > 0 and ^(1) = /(I) - 1 < 1 - 1 = 0, the Intermediate Value 
theorem shows ^(xq) = 0 for some G [0,1]. Then obviously we 
have /(xo) = xq. □ 

Example 2 

Show that if > 0 and m G N, then y has a positive mth root. □ 
Solution 

The function f{x) — x'^ is continuous [Exercise 17.5]. There exists 
6 > 0 so that y < b^; in fact, if y < 1 let 6 = 1 and if ^ > 1 let 
b = y. Thus f{0)<y< f{b) and the Intermediate Value theorem 
implies f{x) = y for some x in (0,6]. So ^ = and x is an mth 
root of y. □ 

Let us analyze the function f(x) = x^ in Example 2 more closely. 
It is a strictly increasing function on [0, oo): 

0 < xi < X2 implies x'^ < x^. 
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Therefore / is one-to-one and each nonnegative y has exactly one 
nonnegative mth root. This assures us that the notation y^/^ is 
unambiguous. In fact, f~^{y) = y^^^ is the inverse function of / 
since f~^ o /(x) = x for x G dom(/) and / o f~^{y) — y ioi y ^ 
dom(/~-'^). Since f{x) — x'^ is continuous, the function f~^{y) = 
continuous on [0, oc) by the next theorem. Note that for 
m — 2 this result appears in Exercise 17.4. 

18.4 Theorem. 

Let f he a continuous strictly increasing function on some interval 
I. Then f{I) is an interval J by Corollary 18.3 and f~^ represents 
a function with domain J. The function f~^ is a continuous strictly 
increasing function on J. 

Proof 

The function f~^ is easily shown to be strictly increasing. Since f~^ 
maps J onto /, the next theorem shows f~^ is continuous. ■ 

18.5 Theorem. 

Let g be a strictly increasing function on an interval J such that g{J) 
is an interval I. Then g is continuous on J. 

Proof 

Consider xq in J. We assume xq is not an endpoint of J; tiny changes 
in the proof are needed otherwise. Then g{xo) is not an endpoint of 
/, so there exists eo > 0 such that {g{xo) — eo^g{xo) + eo) ^ /. 

Let e > 0. Since we only need to verify the e-6 property of The- 
orem 17.2 for small e, we may assume e < eo- Then there exist 
xi,X2 G J such that g{xi) = g{xo) — e and g{x2) = 9{xo) + e. 
Clearly we have xi < xq < X2' Also, if xi < x < X2, then 
g{xi) < g{x) < g{x2), hence g{xo) — e < g{x) < g{xQ) + e, and hence 
\g{x) — g{xo)\ < e. Now if we put 6 = min{x2 — xq^xq — xi}, then 
\x — xo\ < 6 implies xi < x < X2 and hence \g{x) — g{xo)\ < e. ■ 

Theorem 18.5 provides a partial converse to the Intermediate 
Value theorem, since it tells us that a strictly increasing func- 
tion with the intermediate value property is continuous. However, 
Exercise 18.12 shows that a function can have the intermediate value 
property without being continuous. 
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18.6 Theorem. 

Let f be a one-to-one continuous function on an interval I. Then 
f is strictly increasing [xi < X2 implies f{xi) < f{x2)] or strictly 
decreasing [xi < X2 implies f{xi) > /(X2)]. 

Proof 

First we show 

if a < 6 < c in /, then f{b) lies between /(a) and /(c). (1) 

If not, then f{b) > max{/(a), /(c)}, say. Select y so that f{b) > y > 
max{/(a), /(c)}. By the Intermediate Value Theorem 18.2 applied 
to [a, 6] and to [6, c], there exist xi G (a, 6) and X2 G (&, c) such that 
f{xi) = f{x2) = y. This contradicts the one-to-one property of /. 

Now select any ao < 60 in / and suppose, say, that /(ao) < /(^o)- 
We will show / is strictly increasing on /. By (1) we have 

f{x) < /(ao) for X < oq [since x < oq < bo], 

/(^o) < f{x) < f{bo) for ao <x < 60, 

/(60) < f{x) for X > bo [since ao < bo < x]. 

In particular. 



Consider any xi < X2 in /. If xi < ao < ^2, then f{xi) < f{x2) 
by (2) and (3). If xi < X2 < ao, then f{xi) < /(ao) by (2), so by (1) 
we have f{xi) < f{x2). Finally, if ao < xi < X2, then /(ao) < f{x2), 



Exercises 

18.1 Let / be as in Theorem 18.1. Show that if — / assumes its maximum 
at xo G [a, 6], then / assumes its minimum at xq. 

18.2 Reread the proof of Theorem 18.1 with [a, b] replaced by (a, b). Where 
does it break down? Discuss. 



f{x) < /(ao) for all x < ao, 
/(ao) < f{x) for all x > ao- 



(2) 
(3) 



SO that f{xi) < f{x2)' 



18.3 Use calculus to find the maximum and minimum of f{x) = — 6x^ + 
9x + 1 on [0,5). 



§19. Uniform Continuity 

18.4 Let 5' C R and suppose there exists a sequence {xn) in S converging 
to a number xq ^ S. Show there exists an unbounded continuous 
function on S. 

18.5 (a) Let / and g be continuous functions on [a, b] such that f{a) > 

g{a) and f{b) < g{b). Prove f{xo) = g{xo) for at least one xq in 
[a, 6]. 

(b) Show Example 1 can be viewed as a special case of part (a). 

18.6 Prove x = cosx for some x in (0, |^). 

18.7 Prove xe^ = 2 for some x in (0, 1). 

18.8 Suppose / is a real- valued continuous function on R and f{a)f{b) < 0 
for some a, 6 G R. Prove there exists x between a and b such that 
fix) = 0. 

18.9 Prove that a polynomial function / of odd degree has at least one 
real root. Hint: It may help to consider first the case of a cubic, i.e., 
f{x) = ao + aix + a2x'^ + asx^ where as 0. 

18.10 Suppose / is continuous on [0,2] and /(O) = /(2). Prove there exist 
x^y in [0,2] such that \y — x\ = 1 and f{x) = f{y). Hint: Consider 
g{x) = f{x+l)- fix) on [0,1]- 

18.11 (a) Show that if / is strictly increasing on an interval /, then — / is 

strictly decreasing on /. 

(b) State and prove Theorems 18.4 and 18.5 for strictly decreasing 
functions. 

18.12 Let f{x) = sin(^) for x ^ 0 and let /(O) = 0. 

(a) Observe that / is discontinuous at 0 by Exercise 17.10(b). 

(b) Show / has the intermediate value property on R. 

§19 Uniform Continuity 

Let / be a real- valued function whose domain is a subset of R. The- 
orem 17.2 tells us that / is continuous on a set 5 C dom(/) if and 
only if 

for each xq ^ S and e > 0 there is 5 > 0 so that 
X G dom(/) and \x — xq] < S imply \f{x) — f{xo)\ < e. 

The choice of 6 depends on e > 0 and on the point xq in S. 
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Example 1 

We verify (*) for the function f{x) = ^ on (0, oc). Let xq > 0 and 
e > 0. We need to show \f{x) — f{xo)\ < e for |x — xo| sufficiently 
small. Note that 

n/ \ n/ \ 1 1 Xq—X^ [xq — x)(^Xq -\- x) , . 

/(x) - /(Xo) = -2 - -2 = — = -2-2 . (1) 

tAy 0 0 0 

If \x - xo\ < ^, then we have \x\ > ^, \x\ < ^ and |xo + x| < 
These observations and (1) show that if |x — xo| < then 



. \xo-x\-^ 10\xo-x\ 

\f[x) - f{xo)\ < 



V 2 / '^O 



0 



Thus if we set 6 = min{^, then 

|x — xo| < S implies \f{x) — f{xo)\ < e. 

This establishes (*) for / on (0, oo). Note that 6 depends on both e 
and xq. Even if e is fixed, 6 gets small when xq is small. This shows 
that our choice of 6 definitely depends on xq as well as e, though this 
may be because we obtained 6 via sloppy estimates. As a matter of 
fact, in this case 6 must depend on xq as well as 65 see Example 3. 
Figure 19.1 shows how a fixed e requires smaller and smaller 6 as xq 
approaches 0. [In the figure. Si signifies a 6 that works for xi and e, 
82 signifies a 6 that works for X2 and e, etc.] □ 

It turns out to be very useful to know when the 6 in condition 
(*) can be chosen to depend only on e > 0 and 5, so that S does 
not depend on the particular point xq. Such functions are said to 
be uniformly continuous on S. In the definition, the points x and xq 
play a symmetric role, so we will call them x and y. 

19.1 Definition. 

Let / be a real-valued function defined on a set 5 C M. Then / is 
uniformly continuous on S if 

for each e > 0 there exists S > 0 such that 
x,y e S ^iid\x-y\<6 imply \f{x) - f{y)\ < e. 

We will say / is uniformly continuous if / is uniformly continuous 
on dom(/). 
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Note that if a function is uniformly continuous on its domain, 
then it is continuous on its domain. This should be obvious; if it isn't, 
Theorem 17.2 and Definition 19.1 should be carefully scrutinized. 
Note also that uniform continuity is a property concerning a function 
and a set [on which it is defined]. It makes no sense to speak of a 
function being uniformly continuous at each point. 

Example 2 

We show f{x) = ^ is uniformly continuous on any set of the form 
[a, 00) where a > 0. Here a is fixed. Let e > 0. We need to show there 
exists 6 > 0 such that 

X > a, y > a and \x — y\ < 6 imply \f{x) — f{y)\ < e. (1) 

As in formula (1) of Example 1, we have 

x^y^ 
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If we can show is bounded on [a, 00) by a constant M, then we 

X y 

will take 5 — j^. But we have 

y + x _ I 1^1 1 _ 2 

j,2y2 rj^2y rj^y2 " q?> q?> ' 

3 

SO we set 5 = It is now straightforward to verify (1). In fact, 
X > a, y > a and \x — y\ < 6 imply 

x^^^ \x^y xy^ J a'^ 

We have shown / is uniformly continuous on [a, 00) since 6 depends 
only on e and the set [a, 00). □ 

Example 3 

The function f{x) — ^ is not uniformly continuous on the set (0, 00) 
or even on the set (0, 1). 

We will prove this by directly violating the definition of uni- 
form continuity. The squeamish reader may skip this demonstration 
and wait for the easy proof in Example 6. We will show (1) in 
Definition 19.1 fails for e = 1; that is 

for each 5 > 0 there exist x^y in (0,1) such that 

\x-y\<5 and yet - f{y)\ > 1. ^ ^ 



[Actually, for this function, (1) in Definition 19.1 fails for all e > 0.] 

5 
2 



To show (1) it suffices to take ^ = x + | and arrange for 



> 1- (2) 



[The motivation for this maneuver is to go from two variables, x 
and ^, in (1) to one variable, x, in (2).] By (1) in Example 1, (2) is 
equivalent to 



^ ^ {x + l-x){x+l + x) ^ 6{2x + l) 



It suffices to prove (1) for S < ^. To apply (3), let us try x = S ior 
no particular reason. Then 

5(2(5 + f ) _ 5(52/2 _ 5 ^ 5 20 



> —t-t: = — > 1. 



252((5+|)2 954/2 952 9(^)2 9 
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We were lucky! To summarize, we have shown that if 0 < 5 < ^, then 
\f{S) - + 1)1 > 1, so (1) holds with x = 5 and ^ = 5 + |. □ 

Example 4 

Is the function f{x) = uniformly continuous on [—7, 7]? To see if it 
is, consider e > 0. Note that \ f{x) — f{y)\ — \x'^ — y'^\ = |x — 7/| • + 
Since |x + ^| < 14 for x, y in [—7, 7], we have 

\f{x)-f{y)\<U\x-y\ for x,ye[-7,7]. 

Thus if 5 = ^, then 

x,^g[-7,7] and \x - y\ < 6 imply \f{x)-f{y)\<e. 

We have shown that / is uniformly continuous on [—7,7]. A similar 
proof would work for f{x) = x^ on any closed interval. How- 
ever, these results are not accidents as the next important theorem 
shows. □ 

19.2 Theorem. 

// / is continuous on a closed interval [a^b], then f is uniformly 
continuous on [a, 6]. 

Proof 

Assume / is not uniformly continuous on [a, 6]. Then there exists 
e > 0 such that for each 6 > 0 the implication 

"|x -y\<6 implies \f{x) - f{y)\ < e" 

fails. That is, for each 6 > 0 there exist x,y G [a, 6] such that \x — y\ < 
S and yet \f{x) — f{y)\ > e. Thus for each n G N there exist Xn^yn 
in [a, 6] such that \xn - < ^ and yet \f{xn) - f{yn)\ > ^- By 
the Bolzano- Weierstrass Theorem 11.5, a subsequence {x^^) of (x^) 
converges. Moreover, if = \imj^^^Xn^^ then belongs to [a, 6]; 
see Exercise 8.9. Clearly we also have xq = limj^^^ynj^. Since / is 
continuous at xq, we have 

/(xo) = lim /(x^J = lim /(^/nj, 

SO 

lim [/(xnj - /(2/nJ] = 0. 

k^oo 

Since |/(x^^) — f{ynk)\ ^ ^ for all A;, we have a contradiction. We 
conclude / is uniformly continuous on [a, 6]. ■ 



14:4: ^' Continuity 

The preceding proof used only two properties of [a,b]: 

(a) Boundedness, so the Bolzano- Weierstrass theorem applies; 

(b) A convergent sequence in [a, b] converges to an element in [a, b]. 

As noted prior to Theorem 11.9, sets with property (b) are called 
closed sets. Hence Theorem 19.2 has the following generalization. // 
/ is continuous on a closed and bounded set then f is uniformly 
continuous on S. See also Theorems 21.4 and 13.12 that appear in 
enrichment sections. 



Example 5 

In view of Theorem 19.2, the following functions are uniformly 
continuous on the indicated sets: x^^ on [—13,13], ^/x on [0,400], 
x^^ 8in{e^) — e^^cos2x on [— 87r,87r], and ^ on [|,44]. □ 

19.3 Discussion. 

Example 5 illustrates the power of Theorem 19.2, but it still may 
not be clear why uniform continuity is worth studying. One of the 
important applications of uniform continuity concerns the integrabil- 
ity of continuous functions on closed intervals. To see the relevance 
of uniform continuity, consider a continuous nonnegative real- valued 
function / on [0, 1]. For n G N and i = 0, 1, 2, . . . , n — 1, let 

M.,. = sup {/(x) : X G [^, ^] } and m.,n = inf {/(x) : x G [^, ^] } . 

Then the sum of the areas of the rectangles in Fig. 19.2a equals 

^ n—l 

n ^-^ 

i=0 

and the sum of the areas of the rectangles in Fig. 19.2b equals 

^ n—l 

n ^-^ 

i=0 

The function / would turn out to be Riemann integrable provided 
the numbers Un and are close together for large n, i.e., if 

lim {Un - Ln) = 0; (1) 
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see Exercise 32.6. Moreover, we would have f{x)dx = limC/^ = 
limL^. Relation (1) may appear obvious from Fig. 19.2, but uniform 
continuity is needed to prove it. First note 

n-l 
=0 



for all n. Let e > 0. By Theorem 19.2, / is uniformly continuous on 
[0, 1], so there exists 5 > 0 such that 

x,yG[0, 1] and \x - y\ < ^ imply - /(^)| < e. (2) 

Select N so that < 5. Consider n > A^; for i = 0, 1, 2, . . . , n — 1, 
Theorem 18.1 shows there exist xi^yi in ^] satisfying f{xi) — 
vfii^n and = Mi^n- Since \xi - yi\<\ < < (2) shows 



so 



^ n—1 ^ n— 1 

0 < C/^ - = - ^{Mi^n - mi,n) < - V e = e. 



i=0 



i=0 



This proves (1) as desired. 



□ 



The next two theorems show uniformly continuous functions have 
nice properties. 
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19.4 Theorem. 

/// is uniformly continuous on a set S and (5^) is a Cauchy sequence 
in S, then {f{sn)) is a Cauchy sequence. 

Proof 

Let (sji) be a Cauchy sequence in S and let e > 0. Since / is uniformly 
continuous on 5, there exists 5 > 0 so that 

x.yeS and \x - y\ < 6 imply \f{x)-f{y)\<e. (1) 

Since (5^) is a Cauchy sequence, there exists so that 

m^n > N implies — < 5. 

From (1) we see that 

m,n> N implies 1/(5^) - f{sm)\ < e. 

This proves (/(s^)) is also a Cauchy sequence. ■ 

Example 6 

We show /(x) = ^ is not uniformly continuous on (0, 1). Let Sn = ^ 
for n G N. Then (5^) is obviously a Cauchy sequence in (0, 1). Since 
fi^n) = (/(<§n)) is not a Cauchy sequence. Therefore / cannot 
be uniformly continuous on (0, 1) by Theorem 19.4. □ 

The next theorem involves extensions of functions. We say a 
function / is an extension of a function f if 

dom(/) C dom(/) and f{x) = f{x) for all x G dom(/). 
Example 7 

Let f{x) = xsin(^) for x G (0, The function defined by 

xsin(^) for 0 < x < ^ 
0 for X = 0 

is an extension of /. Note that dom(/) = (0, ^] and dom(/) = [0, 
In this case, / is a continuous extension of /. See Fig. 19.3 as well as 
Exercises 17.3(f) and 17.9(c). □ 





Example 8 

Let g{x) = sin(^) for x G (0, The function g can be extended 

to a function g with domain [0, in many ways, but g wih not be 

continuous. See Fig. 19.4. □ 



The function / in Example 7 is uniformly continuous [since / 
is], and / extends to a continuous function on the closed interval. 
The function g in Example 8 does not extend to a continuous func- 
tion on the closed interval, and it turns out that g is not uniformly 
continuous. These examples illustrate the next theorem. 
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19.5 Theorem. 

A real-valued function f on (a, b) is uniformly continuous on (a, b) 
if and only if it can be extended to a continuous function f on [a, b]. 

Proof 

First suppose / can be extended to a continuous function / on [a, b]. 
Then / is uniformly continuous on [a, b] by Theorem 19.2, so clearly 
/ is uniformly continuous on (a, 6). 

Suppose now that / is uniformly continuous on (a, b). We need to 
define /(a) and f{b) so that the extended function will be continuous. 
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It suffices for us to deal with /(a). We make two claims: 

if (sn) is a sequence in (a, b) converging 
to a, then (/(s^)) converges, 

and 

if (sji) and (t^) are sequences in (a, b) converging 
to a, then lim/(5^) = lim/(t^). 

Momentarily accepting (1) and (2) as valid, we define 

/(a) = lim/(5^) for any sequence 
(sn) in (a, b) converging to a. 



(1) 



(2) 



(3) 



Assertion (1) guarantees the limit exists, and assertion (2) guaran- 
tees this definition is unambiguous. The continuity of / at a follows 
directly from (3); see Exercise 17.15. 

To prove (1), note that (sn) is a Cauchy sequence, so (/(s^)) is 
also a Cauchy sequence by Theorem 19.4. Hence (/(s^)) converges 
by Theorem 10.11. To prove (2) we create a third sequence (un) such 
that (sji) and (t^) are both subsequences of (un)- In fact, we simply 
interleaf (sn) and (t^): 

= (^l, ti, 52, ^2, 53,^3, 54, ^4, 55, ^5, . . .). 

It is evident that limi^^ = a, so limf{un) exists by (1). Theorem 11.3 
shows the subsequences (/(s^)) and (/(t^)) of {f{un)) both converge 
to lim f{un), so lim f{sn) = lim /(t^). ■ 

Example 9 

Let h{x) = for X ^ 0. The function h defined on R by 



h{x) 



for X 7^ 0 



smx 

X 

1 for X = 0 



is an extension of h. Clearly h and h are continuous at all x ^ 0. It 
turns out that h is continuous at x = 0 [see below], so h is uniformly 
continuous on (a,0) and (0,6) for any a < 0 < 6 by Theorem 19.5. 
In fact, h is uniformly continuous on R [Exercise 19.11]. 

We cannot prove the continuity of /i at 0 in this book because 
we do not give a definition of sinx. The continuity of /i at 0 reflects 




the fact that sinx is differentiable at 0 and its derivative there is 
cos(O) = 1, i.e., 

. sin X — sin 0 . . sin x 
1 = hm = hm ; 

x^O X — 0 x^O X 

see Fig. 19.5. The proof of this depends on how sinx is defined; 
see the brief discussion in 37.12. For a discussion of this hmit and 
L'Hospital's rule, see Example 1 in §30. □ 

Here is another useful criterion that implies uniform continuity. 
19.6 Theorem. 

Let f be a continuous function on an interval I [I may be bounded 
or unbounded]. Let I be the interval obtained by removing from I 
any endpoints that happen to be in I. If f is differentiable on I and 
if f is bounded on I , then f is uniformly continuous on I. 

Proof 

For this proof we need the Mean Value theorem, which can be found 
in most calculus texts or later in this book [Theorem 29.3]. 

Let M be a bound for f on / so that < M for all x. 

Let e > 0 and let 5 = -p^. Consider a,b ^ I where a < b and 
\b — a\ < S. By the Mean Value theorem, there exists x G (a, b) such 
that f{x) = so 

1/(6) - f{a)\ = \ f\x)\ • |6 - a| < M\b - a\ < M6 = e. 

This proves the uniform continuity of f on L ■ 
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Example 10 

Let a > 0 and consider f{x) = Since f\x) = — ^ we have 
1/^^)1 ^ ^ on [a, oc). Hence / is uniformly continuous on [a, oo) by 
Theorem 19.6. For a direct proof of this fact, see Example 2. □ 

Exercises 

19.1 Which of the following continuous functions are uniformly continuous 
on the specified set? Justify your answers. Use any theorems you wish. 



(a) 


fix) 


= x^^ sinx — cos 


(b) 


fix) 


= x^ 


on 


[0,1], 


(c) 


fix) 


= x^ 


on 


(0,1), 


(d) 


fix) 


= x^ 


on 


M, 


(e) 


fix) 


_ J_ 


on 


(0,1], 


(f) 


fix) 


= sin 


1 


on (0,1], 


(g) 


fix) 


= X^ 


sin 


I on (0,1]. 



19.2 Prove each of the following functions is uniformly continuous on the 
indicated set by directly verifying the e-S property in Definition 19.1. 

(a) f{x) = 3x^11 onR, 

(b) f{x)=x^ on [0,3], 

(c) f{x) = 1 on [^,oc). 

19.3 Repeat Exercise 19.2 for the following. 

(a) fix) = ^ on [0,2], 

(b) fix) = ^ on [l,oo). 

19.4 (a) Prove that if / is uniformly continuous on a bounded set 5, 

then / is a bounded function on 5*. Hint: Assume not. Use 
Theorems 11.5 and 19.4. 

(b) Use (a) to give yet another proof that ^ is not uniformly 
continuous on (0, 1). 
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19.5 Which of the fohowing continuous functions is uniformly continuous 
on the specified set? Justify your answers, using appropriate theorems 
or Exercise 19.4(a). 

(a) tanx on [0, 

(b) tanx on [0, |^), 

(c) ^ sin^ X on (0,7r], 

(d) ^ on (0,3), 
(^) ^ (3,oc), 
(f) ^on(4,oo). 

19.6 (a) Let f{x) = ^/x for x > 0. Show f is unbounded on (0, 1] but 

/ is nevertheless uniformly continuous on (0,1]. Compare with 
Theorem 19.6. 

(b) Show / is uniformly continuous on [1, oc). 

19.7 (a) Let / be a continuous function on [0,oo). Prove that if / is 

uniformly continuous on [/c, oo) for some /c, then / is uniformly 
continuous on [0,oo). 

(b) Use (a) and Exercise 19.6(b) to prove ^/x is uniformly continuous 
on [0, oo). 

19.8 (a) Use the Mean Value theorem to prove 

I sin X — smy\ < \x — y\ 
for all x^y in M; see the proof of Theorem 19.6. 
(b) Show sinx is uniformly continuous on R. 

19.9 Let f{x) =xsm{l) for x ^ 0 and /(O) = 0. 

(a) Observe / is continuous on R; see Exercises 17.3(f) and 17.9(c). 

(b) Why is / uniformly continuous on any bounded subset of R? 

(c) Is / uniformly continuous on R? 

19.10 Repeat Exercise 19.9 for the function g where g{x) = x^sin(^) for 
X ^ 0 and g{0) = 0. 

19.11 Accept the fact that the function h in Example 9 is continuous on R; 
prove it is uniformly continuous on R. 
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19.12 Let / be a continuous function on [a, 6]. Show the function /* defined 
by = sup{/(y) : a < y < x}, for x G [a, 6], is an increasing 

continuous function on [a, 6]. 



§20 Limits of Functions 

A function / is continuous at a point a provided the values f{x) are 
near the value /(a) for x near a [and x G dom(/)]. See Definition 17.1 
and Theorem 17.2. It would be reasonable to view /(a) as the limit 
of the values /(x), for x near a, and to write liuix^a f{x) = /(a). In 
this section we formalize this notion. This section is needed for our 
careful study of derivatives in Chap. 5, but it may be deferred until 
then. 

We will be interested in ordinary limits, left-handed and right- 
handed limits and infinite limits. In order to handle these various 
concepts efficiently and also to emphasize their common features, 
we begin with a very general definition, which is not a standard 
definition. 

20.1 Definition. 

Let 5 be a subset of R, let a be a real number or symbol oo or — oo 
that is the limit of some sequence in 5, and let L be a real number 
or symbol +00 or — oc. We write lim^^^s f{x) — L ii 

/ is a function defined on 5, (1) 

and 

for every sequence (x^) in S with limit a, . . 

we havelim^^oo f{xn) = L. 

The expression "lim^^^s f{xy^ is read "limit, as x tends to a along 5, 
of /(x)." 

20.2 Remarks. 

(a) From Definition 17.1 we see that a function / is continuous at 
a in dom(/) = 5 if and only if lim^^^s f{x) = f{a). 
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(b) Observe that limits, when they exist, are unique. This fohows 
from (2) of Definition 20.1, since hmits of sequences are unique, 
a fact that is verified at the end of §7. □ 

We now define the various standard hmit concepts for functions. 

20.3 Definition. 

(a) For a G R and a function / we write hm^^^a f{x) — L provided 
hm^^^s f{x) — L for some set 5 = J \ {a} where J is an 
open interval containing a. linix^a f{x) is called the [two-sided\ 
limit of f at a. Note / need not be defined at a and, even if / 
is defined at a, the value /(a) need not equal Xmix^a f{x). In 
fact, /(a) = liuix^a f{x) if and only if / is defined on an open 
interval containing a and / is continuous at a. 

(b) For a G R and a function / we write limx^a+ f{^) — ^ Pro- 
vided lim^^^s f{x) = L for some open interval S = (a, 6). 
lim^^^+ f{x) is the right-hand limit of f at a. Again / need 
not be defined at a. 

(c) For a G R and a function / we write lim^,^^- f{x)=L pro- 
vided lim^^^s f{x) = L for some open interval S = (c, a), 
lim^^^- f{x) is the left-hand limit of fat a. 

(d) For a function / we write lim^^^oo f{x) = L provided 
lim^^^s f{x) = L for some interval S = (c, oo). Likewise, 
we write lim^^^-oo f{x) — L provided lim^^_^s f{x) — L for 
some interval 5 = (— oo, 6). 

The limits defined above are unique; i.e., they do not depend on 
the exact choice of the set S [Exercise 20.19]. 

Example 1 

We have lima;^4 x^ — 64 and lima^^2 - — \ because the functions x^ 
and ^ are continuous at 4 and 2, respectively. It is easy to show 
lim^^o+ \ — +^ lim^^^Q- ^ = — oo; see Exercise 20.14. It 
follows that lim^^^o \ does not exist; see Theorem 20.10. □ 

Example 2 

Consider lima^^2 This is not like Example 1, because the func- 

tion under the limit is not even defined at x = 2. However, we can 
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rewrite the function as 

-4 _ (x-2)(x + 2) 



X + 2 for X 7^ 2. 



r.2 



Now it is clear that hma;^2 = ^^^x^2{x + 2) = 4. We should 
emphasize that the functions and x + 2 are not identical. The 
domain of f{x) = is (—00,2) U (2,00) while the domain of 

/(x) = X + 2 is R, so that / is an extension of /. This seems like 
nitpicking and this example may appear silly, but the function /, 
not /, arises naturally in computing the derivative of g{x) = x^ at 
X = 2. Indeed, using the definition of derivative we have 

g\2) = lim — ^ = lim -, 

^ ^ x^2 X -2 x^2 X -2 

SO our modest computation above shows g^{2) = 4. Of course, this 
is obvious from the formula g^{x) — 2x, but we are preparing the 
foundations of limits and derivatives, so we are beginning with simple 
examples. □ 

Example 3 

Consider lim^^^i • We employ a trick that should be familiar by 
now; we multiply the numerator and denominator by ^/x + 1 and 
obtain 

^/x-l _ {^/x-l){^/x+l) _ X-\ 1 



x-\ (x-l)(v^+l) (x-l)(v^+l) 

for X ^ 1. Hence lim^;^! ~ l^^c^i ^^J+T ~ \' We have just 

laboriously verified that if h{x) = y/x^ then h\l) — □ 



Example 4 

Let f{x) -^^32)3 foi" X y^2. Then lim^^oo f{x) = lim^^^-oo f{x) 
0, lim^^2+ f{x) = +00 and lim^^2- /(^) 

To verify lim^^^oo f{x) = 0, we consider a sequence (xn) such 
that lim^^oo Xn — +00 and show lim^^oo f{xn) — 0. This will show 
lim^^^s /(x) = 0 for 5 = (2,00), for example. Exercise 9.11 and 
Theorem 9.9 show lim^^oo(^n — 2)^ = +00, and then Theorem 9.10 
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shows 

lim f{xn)= lim(x,-2)-3 = 0. (1) 

Here is a direct proof of (1). Let e > 0. For large n, we need \xn — 
2\~^ < e or < \xn - 2p or e~^/^ < \xn - 2|. The last inequality 
holds if Xn > e~^/^ + 2. Since lim^^oo — +oo, there exists N so 
that 

n> N implies Xn > e"^/^ + 2. 

Reversing the algebraic steps above, we find 

n > N implies \xn — 2\~^ < e. 

This establishes (1). 

Similar arguments prove lim^^^-oo f{x) = 0 and lim2,^2+ /(^) = 
+00. To prove lim3,^2- /(^) — —oo, consider a sequence (x^) such 
that Xn < 2 for all n and lim^^oo = 2. Then 2 — > 0 for 
all n and lim^^oo(2 — Xn) — 0. Hence lim^^oo(2 — Xn)^ = 0 by 
Theorem 9.4, and 9.10 implies lim^^oo(2 — Xn)~^ — +oo. It follows 
[Exercise 9.10(b)] that 

lim f{xn) = lim {xn - 2)"^ = -oo. (2) 

This proves that lim^^2'S' /(^) — foi" S — (—00,2), so that 

lim2,^2- /(^) = "CO. Of course, a direct proof of (2) also can be 
given. 

The limits discussed above are confirmed in Fig. 20.1. □ 

We will discuss the various limits defined in Definition 20.3 fur- 
ther at the end of this section. First we prove some limit theorems 
in considerable generality. 

20.4 Theorem. 

Let fi and /2 be functions for which the limits Li = lim^^^s fi{x) 
and L2 = lim^^^s f2{x) exist and are finite. Then 

(i) lim^^^s(/i + f2){x) exists and equals Li + L2; 

(ii) lim^^^s(/i/2)(x) exists and equals L1L2; 

(iii) lim^^^s{fi/ f2){x) exists and equals L1/L2 provided L2 ^ 0 
and f2{x) ^ 0 for x ^ S. 
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Proof 

The hypotheses imply both fi and /2 are defined on S and a is the 
limit of some sequence in S. Clearly the functions /i + /2 and /1/2 
are defined on S and so is /1//2 if f2{x) ^ 0 for x G 5. 

Consider a sequence (x^) in S with limit a. By hypotheses we 
have Li limn^oo fi{xn) and L2 lim^^oo /2(^n)- Theorems 9.3 
and 9.4 now show 

lim (/i + /2)(x^) = lim /i(x^) + lim /2(x^) = Li + L2 

and 



lim {hf2){xn) 



lim /i(x^) 



lim /2(x^) 



L1L2. 



Thus (2) in Definition 20.1 holds for /i + /2 and /1/2, so that (i) and 
(ii) hold. Likewise (iii) follows by an application of Theorem 9.6. ■ 



Some of the infinite variations of Theorem 20.4 appear in Exer- 
cise 20.20. The next theorem is less general than might have been 
expected; Example 7 shows why. 



]^58 3. Continuity 



20.5 Theorem. 

Let f be a function for which the limit L = lim^^^s f{x) exists and 
is finite. If g is a function defined on {f{x) : x ^ S} U {L} that is 
continuous at L, then lim^^^s g o f[x) exists and equals g{L). 

Proof 

Note g o f is defined on S by our assumptions. Consider a sequence 
(xn) in S with limit a. Then we have L = lim^^oo f{xn)- Since g is 
continuous at L, it follows that 

g{L) = lim g{f{xn)) = lim go f{xn). 
Hence lim^^^s g o f{x) = g{L). ■ 

Example 5 

If / is a function for which the limit L = lim^^^a f{x) exists and is 
finite, then we have lim^^^a 1/(^)1 = 1^1- This follows immediately 
from Theorem 20.5 with g{x) = \x\. Similarly, we have lim^^^a e-^^^^ = 
if we accept the fact that g{x) = is continuous on R. □ 

Example 6 

If / is a function for which lim3,^o+ /(^) — 0 lim^^^oo f{x) = 
|, then we have lim3,^o+ ^"^^^^ = = 1, lim^^^oo ^"^^^^ — ^2, 
lim2,^o+ sin(/(x)) = sin(O) = 0 and lim^^^oo sin(/(x)) = sin | = 1. 

□ 

Example 7 

We give an example to show continuity of g is needed in Theo- 
rem 20.5. Explicitly, we give examples of functions / and g such 
that lim^^^o f{x) = 1, lim^^^i g{x) = 4 and yet lim^^^o^ o f{x) does 
not exist. One would expect this limit to exist and to equal 4, but in 
the example f{x) will equal 1 for arbitrarily small x while ^(1) ^ 4. 
The functions / and g are defined by f{x) = 1 + xsin ^ for x ^ 0, 
g{x) = 4 for X ^ 1, and ^(1) = —4. Clearly lima;^o/(^) = 1 and 
lim^^i g{x) = 4. Let = | forn G N. Then f{xn) = 1 + f sin(^); 
hence f{xn) = 1 for even n and f{xn) 1 for odd n. Therefore 
g o f{xn) = —4 for even n and g o f{xn) = 4 for odd n. Since 
lim^ 

-^oo — O5 we conclude lim^^^o 9 ^ /('^) does not exist. D 
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As in Theorem 17.2, the hmits defined in Definitions 20.1 and 20.3 
can be recast to avoid sequences. First we state and prove a typi- 
cal result of this sort. Then, after Corollary 20.8, we give a general 
scheme without proof. 

20.6 Theorem. 

Let f be a function defined on a subset S o/M^ let a be a real number 
that is the limit of some sequence in S, and let L be a real number, 
then lim^^^s f{x) — L if and only if 

for each e > 0 there exists 5 > 0 such that 
X ^ S and \x — a\ < 5 imply \ f{x) — L\ < e. 

Proof 

We imitate our proof of Theorem 17.2. Suppose (1) holds, and con- 
sider a sequence (xn) in S such that lim^^oo = a. To show 
lim^^oo f{xn) = L, consider e > 0. By (1) there exists 6 > 0 such 
that 

X ^ S and \x — a\ < 6 imply \f{x) — L\ < e. 

Since lim^^oo — there exists a number such that n > N 
implies \xn — a\ < 5. Since Xn ^ S for all n, we conclude 

n > N implies \f{xn) — L\ < e. 

Thus lim^^oo f{xn) L. 

Now assume lim^^^s f{x) = L, but (1) fails. Then for some e > 0 
the implication 

"x G S and \x — a\ < 6 imply \f{x) — L\ < e" 

fails for each 6 > 0. Then for each n G N there exists Xn in S 
where \xn — a\ < ^ while \ f{xn) — L\ > e. Hence (x^) is a sequence 
in S with limit a for which lim^^oo f{xn) = L fails. Consequently 
lim^^^s f{x) = L fails to hold. ■ 

20.7 Corollary. 

Let f be a function defined on J \ {a} for some open interval J 
containing a, and let L be a real number. Then limx^af{x) — L if 
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and only if 

for each e > 0 there exists 6 > 0 such that 
0 < \x — a\ < 6 implies \ f{x) — L\ < e. 



(1) 



20.8 Corollary. 

Let f be a function defined on some interval {a^h), and let L he a 
real number. Then lim3,^^+ f{x) — L if and only if 

for each e > 0 there exists 5 > 0 such that . . 

0 < X < a + 5 implies \ f{x) — L| < e. 

20.9 Discussion. 

We now consider linia^^g f{x)=L where L can be finite, +oo or 
— oo, and 5 is a symbol a, a~, oo or — oo [here a G R]. Note 
we have 15 [= 3 • 5] different sorts of hmits here. It turns out that 
liuix^s f{x) — L ii and only if 

for each there exists such that . . 

implies 

For finite limits L, the first and last blanks are filled in by "e > 0" 
and — L| < e." For L = +oo, the first and last blanks are filled 

in by "M > 0" and "/(x) > M," while for L = -oo they are filled 
in by "M < 0" and "/(x) < M." When we consider liuix^afix), 
then / is defined on J \ {a} for some open interval J containing 
a, and the second and third blanks are filled in by "5 > 0" and 
"0 < |x — a| < 5." For lim3,^^+ f{x) we require / to be defined on 
an interval (a, b) and the second and third blanks are filled in by 
"(5 > 0" and "a < x < a + 5." For lim^,^^- f{x) we require / to 
be defined on an interval (c, a) and the second and third blanks are 
filled in by "5 > 0" and "a — S<x< a." For lima^^oo f{x) we require 
/ to be defined on an interval (c, oo) and the second and third blanks 
are filled in by "o: < oo and < x." A similar remark applies to 
lim^^_oo/(^). 

The assertions above with L finite and s equal to a or a+ are 
contained in Corollaries 20.7 and 20.8. □ 



20.10 Theorem. 

Let f be a function defined on J \ {a} for some open interval 
J containing a. Then limx^af{x) exists if and only if the limits 
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limx^a+ f{x) and lim^,^^- f{x) both exist and are equal, in which 
case all three limits are equal. 

Proof 

Suppose \i-mx^af{x) = L and L is finite. Then (1) in Corol- 
lary 20.7 holds, so (1) in Corollary 20.8 obviously holds. Thus we 
have lim^^^+ f{x) = L; similarly lim^^^- f{x) = L. 

Now suppose lim3,^^+ f{x) = lim^,^^- f{x) — L where L is finite. 
Consider e > 0; we apply Corollary 20.8 and its analogue for a~ to 
obtain 5i > 0 and ^2 > 0 such that 

a < X < a + (5i implies \f{x) — L\ < e 

and 

a — 82 < X < a implies \f{x) — L\ < e. 

li 5 — min{(5i, 82}^ then 

<\x — a\ < 5 implies \f{x) — L| < e, 

so lim^^^a f{x) = Lhy Corollary 20.7. 

Similar arguments apply if the limits L are infinite. For example, 
suppose Imix^a f{x) = +00 and consider M > 0. There exists 6 > 0 
such that 

0 <\x - a\ < 6 implies f{x) > M. (1) 

Then clearly 

a < X < a + 6 implies f{x) > M (2) 

and 

a — S < X < a implies f{x) > M, (3) 

so that lim^^^+ f{x) lim^^^- f{x) +00. 

As a last example, suppose lim^^^+ f{x) = lim^,^^- f{x) = +oc. 
For each M > 0 there exists 5i > 0 so that (2) holds, and there 
exists (^2 > 0 so that (3) holds. Then (1) holds with S = min{(5i, 62}. 
We conclude lim^^^a f{x) +00. ■ 
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20.11 Remark. 

Note lima^^_oo f{x) is very similar to the right-hand hmits lim^^^+ 
f{x). For example, if L is finite, then lim3,^^+ f{x) = L if and only 
if 

for each e > 0 there exists a > a such that , . 

a < X < a implies \ f{x) — L| < e, 

since a > a if and only if = a + 5 for some 5 > 0; see Corol- 
lary 20.8. If we set a = — oc in (1), we obtain the condition (1) in 
Discussion 20.9 equivalent to lim^^^-oo f{x) — L. 

In the same way, the limits lim^^^oo f{x) and lim^,^^- f{x) will 
equal L [L finite] if and only if 

for each e > 0 there exists a < a such that . . 

a < X < a implies \ f{x) — L\ < e. 

Obvious changes are needed if L is infinite. □ 



Exercises 

20.1 Sketch the function f{x) = Determine, by inspection, the lim- 
its hma^^oo f{x), \im^^o+ f{x), hm^^Q- f{x), lim^^^-oo /(x) and 
lima^^o f{x) when they exist Also indicate when they do not exist. 

20.2 Repeat Exercise 20.1 for f{x) = ^. 

20.3 Repeat Exercise 20.1 for f{x) = See Example 9 of §19. 

20.4 Repeat Exercise 20.1 for f{x) = xsin^. 

20.5 Prove the limit assertions in Exercise 20.1. 

20.6 Prove the limit assertions in Exercise 20.2. 

20.7 Prove the limit assertions in Exercise 20.3. 

20.8 Prove the limit assertions in Exercise 20.4. 

20.9 Repeat Exercise 20.1 for f{x) = 

20.10 Prove the limit assertions in Exercise 20.9. 

20.11 Find the following limits. 

(a) lim,^, (b) lim.^f, , 6 > 0 

(c) \\m.x^a "^^.1° Eint: x^—a^ = (x— a)(a;^+aa;+a^). 



Exercises 

20.12 (a) Sketch the function f{x) = {x - l)-^{x - 2) -2. 

(b) Determine hma,^2+ f{^)^ l™x^2- f{^)^ /(^) 
hm^^i- f{x). 

(c) Determine hm^^2 f{x) and hm^^^i f{x) if they exist. 

20.13 Prove that if limx^a f{x) = 3 and limx^a 9{x) = 2, then 

(a) hm,^,[3/(x)+^(x)2] = 13, 

(b) hm,^,^ = I 

(c) hm,^« y3/(x) + 8g{x) = 5. 

20.14 Prove hm2,^o+ ^ = +c>c and hm^^^o- ^ = —00. 

20.15 Prove hma;^-cx) f{x) = 0 and hma,^2+ /(^) = +^0 for the function 
/ in Example 4. 

20.16 Suppose the hmits Li = \imx^a+ /i(^) ^ind L2 = \imx^a+ f2{x) 
exist. 

(a) Show if fi{x) < f2{x) for all x in some interval {a^b)^ then 
Li < L2. 

(b) Suppose that, in fact, fi{x) < f2{x) for all x in some interval 
(a, 6). Can you conclude Li < L2? 

20.17 Show that if \imx^^+ fi{x) = \imx^a+ f^{x) = L and if fi{x) < 
f2{x) < fs{x) for all x in some interval (a, 6), then \imx^a+ f2{x) = 
L. This is called the squeeze lemma. Warning: This is not immediate 
from Exercise 20.16(a), because we are not assuming \imx^^+ f2{x) 
exists; this must be proved. 

20.18 Let f{x) = for x ^ 0. Show lim^^o /(^) exists and 
determine its value. Justify all claims. 

20.19 The limits defined in Definition 20.3 do not depend on the choice 
of the set 5'. As an example, consider a < 61 < 62 and suppose / 
is defined on (a, 62). Show that if the limit limg^^^s f{x) exists for 
either S = (a, 61) or S = (a, 62), then the limit exists for the other 
choice of 5' and these limits are identical. Their common value is 
what we write as limx^a+ fi^)- 

20.20 Let /i and /2 be functions such that lim^^^^^s fi{x) = +oc and such 
that the limit L2 = lim^^^^^s f2{x) exists. 

(a) Prove \imx^^s{fi + f2){x) = +00 if L2 7^ — oc. Hint: Use 
Exercise 9.11. 
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(b) Prove lim^^^s {fif2){x) = +oc if 0 < L2 < +oc. Hint: Use 
Theorem 9.9. 

(c) Prove lim^^fj^s {fif2){x) = —00 if —00 < L2 < 0. 

(d) What can you say about lim^^^s {fif2){x) if L2 = 0? 
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In this section and the next section we continue the introduction to 
metric space ideas initiated in §13. More thorough treatments appear 
in [33,53] and [62]. In particular, for this brief introduction we avoid 
the technical and somewhat confusing matter of relative topolo- 
gies that is not, and should not be, avoided in the more thorough 
treatments. 

We are interested in functions between metric spaces (5, d) and 
We will write "f:S 5*" to signify dom(/) = 5 and / 
takes values in 5*, i.e., f{x) G 5* for all s ^ S. 

21.1 Definition. 

Consider metric spaces (5, d) and (5*,^*). A function f:S^S^is 
continuous at sq in S if 

for each e > 0 there exists 6 > 0 such that , . 

d{s, So) < S implies d%f{s), f{so)) < e. ^ ^ 

We say / is continuous on a subset of 5 if / is continuous at each 
point of E. The function / is uniformly continuous on a subset E of 
5 if 

for each e > 0 there exists 5 > 0 such that . . 

s,t e E and d{s,t) < 6 imply /(t)) < e. ^ ' 

Example 1 

Let 5 = 5* = R and d = d"^ = dist where, as usual, dist(a, b) \a—b\. 
The definition of continuity given above is equivalent to that in §17 
in view of Theorem 17.2. The definition of uniform continuity is 
equivalent to that in Definition 19.1. □ 
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Example 2 

In several variable calculus, real- valued functions with domain or 
R^, or even R^, are extensively studied. This corresponds to the case 

5 = R^ 



d{x,y) = 



1/2 



5* = R and d* = dist. We will not develop the theory, but gener- 
ally speaking, functions that look continuous will be. Some examples 
on R^ are f{xi,X2) — x\ ^ x^, f{xi,X2) = x\X2\/ x\ + ^2 + 1, 
f{xijX2) = cos(xi — X2). Some examples on R^ are g{xi,X2,xs) = 



+ + x^, g{xi,X2,xs) = X1X2 + xixs + g{xi,X2,xs) 



gxi+x2 iog(x| + 2). 



□ 



Example 3 

Functions with domain R and values in R^ or R^, or generally R^, 
are also studied in several variable calculus. This corresponds to the 
case S = R, d = dist, 5* = R^ and 



1/2 



The images of such functions are what nonmathematicians often call 
a "curve" or "path." In order to distinguish a function from its image, 
we will adhere to the following terminology. Suppose 7: R ^ R^ is 
continuous. Then we will call 7 a path; its image 7(R) in R^ will be 
called a curve. We will also use this terminology if 7 is defined and 
continuous on some subinterval of R, such as [a, 6]; see Exercise 21.7. 

As an example, consider 7 where 7(t) = (cost, sin t). This func- 
tion maps R onto the circle in R^ about (0,0) with radius 1. 

More generally 70 (t) = (a cos t, 6 sin t) maps R onto the ellipse with 

2 2 

equation ^ ^ ^ = I; see Fig. 21.1. 



The graph of an ordinary continuous function /:R ^ R looks 
like a curve, and it is! It is the curve for the path 7(t) = (t, /(t)). 
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FIGURE 21.2 

Curves in can be quite exotic. For example, the curve for the 
path h{t) = (cost, sin |) is a helix. See Fig. 21.2. □ 

We did not prove that any of the paths above are continuous, 
because we can easily prove the following general fact. 
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21.2 Proposition. 

Consider a function 7 : [a, b] and write 

Jit) = ih{t),f2it),...,fkit)) for te[a,b]; 

thus /i,/2,---,A real-valued functions on [a, 6]. Then 7 is 
continuous, i.e., a path, if and only if each fj is continuous. 

Proof 

Both implications follow from formula (1) in the proof of Lemma 13.3 
and Exercise 13.2: 

\xj -yj\ < d'ix.y) < \/fcmax{|x^- -yj\ : j = 1, 2, . . . , A;}. (1) 

For t,to in [a, 6], (1) implies 

\fjit)-fAto)\<d*{l{t),^{to)) for i = l,...,fc, (2) 

and d*(7(t),7(to)) < \/fcmax{|/,(t) - /,(to)| : j = 1, 2, . . . , fc}. (3) 

Suppose 7 is continuous on [a, 6], and consider some j in 
{1, 2, . . . , A;}. To show fj is continuous at t^ in [a, 6], given e > 0, 
select 5 > 0 so that (i*(7(t), 7(^0)) < ^ for |t - to| < 5. Then by (2), 
1^ — ^o| < ^ implies \fj{t) — /j(to)| < e. So /j is continuous on [a, 6]. 

Now suppose that each fj is continuous on [a, 6], and consider 
e > 0. For each j, there is 5j > 0 such that 

\t - to\ < Sj implies \fj{t) - fj{to)\ < 

For 6 = min{(5i, ^2, . . . , 5/^;} and \t — to\ < 6, we have 
max{|/^(t) -/^(to)! : j = 1,2,...,A;} < 

so by (3) we have (i*(7(t), 7(^0)) < e. Thus 7 is continuous at to- ■ 

The next theorem shows continuity is a topological property; see 
Discussion 13.7. 

21.3 Theorem. 

Consider metric spaces {S,d) and (5*,^*). A function f-.S^S"" is 
continuous on S if and only if 

f~^{U) is an open subset of S . . 

for every open subset U of S"" . 



]^gg 3. Continuity 



Recall f-\U) = {s e S : f{s) G U}. 



Proof 

Suppose / is continuous on S. Let U be an open subset of 5*, and 
consider sq G f~^{U). We need to show sq is interior to f~^{U). 
Since /(sq) G [/ and C/ is open, we have 

[s* eS* ■.d\s\f{so))<e}CU (2) 

for some e > 0. Since / is continuous at 5o, there exists 5 > 0 such 
that 

d(5,5o) < 5 imphes (f{f{s)J{si^)) < e. (3) 

From (2) and (3) we conclude d{s, sq) < S imphes f{s) is in U; hence 
s e f~^{U). That is, 

{seS:d{s,so)<S}Cf-\U), 

so that Sq is interior to f~^{U). 

Conversely, suppose (1) holds, and consider sq ^ S and e > 0. 
Then i7 = {5* G 5* : d*(5*,/(5o)) < e} is open in 5*, so f-^{U) is 
open in 5. Since sq G f~^{U), for some 5 > 0 we have 

{sG5:d(s,So) <<5} C/-i(;7). 

It follows that 

d{s, So) < S implies d*(/(s), /(^o)) < e. 
Thus / is continuous at sq. ■ 

Continuity at a point is also a topological property; see Exer- 
cise 21.2. Uniform continuity is a topological property, too, but if 
we made this precise we would be led to a special class of topologies 
given by so-called "uniformities." 
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We will show continuous functions preserve two important topo- 
logical properties: compactness, and connectedness which will be 
defined in the next section. The next theorem and corollary illustrate 
the power of compactness. 

21.4 Theorem. 

Consider metric spaces (S^d), (S'*,(i*) and a continuous function 
f:S^ 5*. Let E be a compact subset of S. Then 

(i) f{E) is a compact subset of S"" , and 

(ii) / is uniformly continuous on E. 

Proof 

To prove (i), let U be an open cover of f{E). For each U eU^ f~^{U) 
is open in S. Moreover, {f~^{U) : U G ZY} is a cover of E. Hence 
there exist f/i, • • • , Um in U such that 

E C f-\Ui) U f-\U2) U . . . U f-\U^). 

Then 

f{E)CUiUU2U---UUm, 

so {i7i, ?72, . . . , Um} is the desired finite subcover oiU for f{E). This 
proves (i). 

To establish (ii), let e > 0. For each s ^ E there exists 6s > 0 
[this 6 depends on s] such that 

d{s,t)<Ss implies d%f{s)J{t)) (1) 

For each s e E, let Vs = {t e S : d{s,t) < Then the family 

V = {Vs : 5 G E'} is an open cover of E. By compactness, there exist 
finitely many points 5i, 52, . . . , 5^ in such that 

ECVs,UVs,U---UVs^. 

Let S = ^ min{Ssi^ ^S25 • • • 5 ^sn}- We complete the proof by showing 

s.teE and d{s,t) < 6 imply d%f{s)J{t)) < e. (2) 

For some /c in {1, 2, ... , n} we have s G 1^^, i.e., s^) < ^^sk- Also 
we have 

d{t, Sk) < d{t, s) + d{s, Sk) < S + ^6sj^ < ^s^. 
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Therefore applying (1) twice we have 

d*{f{s),f{s,))<'- and d*{f{t),f{sk))<^. 
Hence /(t)) < e as desired. ■ 

Assertion (ii) in Theorem 21.4 generahzes Theorem 19.2. The 
next corohary should be compared with Theorem 18.1. 

21.5 Corollary. 

Let f be a continuous real-valued function on a metric space (S^d). 
If E is a compact subset of S, then 
(i) / is bounded on E, 

(ii) / assumes its maximum and minimum on E. 
Proof 

Since f{E) is compact in R, the set f{E) is bounded by Theo- 
rem 13.12. This implies (i). 

Since f{E) is compact, it contains sup/(£') by Exercise 13.13. 
Thus there exists 5o G ^ so that f{so) = sup /(£*). This tells us 
/ assumes its maximum value on E at the point sq. Similarly, / 
assumes its minimum on E. ■ 

Example 4 

All the functions / in Example 2 are bounded on any compact subset 
of R^, i.e., on any closed and bounded set in R^. Likewise, all the 
functions g in Example 2 are bounded on each closed and bounded 
set in R^. □ 

Example 5 

Let 7 be any path in R^; see Example 3. For — oc < a < 6 < oc, 
the image 7([a,6]) is closed and bounded in R^ by Theorem 21.4. 
Note Corollary 21.5 does not apply in this case, since the set 5* in 
Theorem 21.4 is R^, not R. Theorem 21.4 also tells us 7 is uniformly 
continuous on [a, b]. Thus if e > 0, there exists 6 > 0 such that 

5, t G [a, b] and \s — t\ < 6 imply ^(7(5), 7(t)) < e. 



This fact is useful in several variable calculus, where one integrates 
along paths 7; compare Discussion 19.3. □ 
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Example 6 

Consider a function / : ^ M, where be a compact subset of R. 
We will show / is continuous if and only if its graph G = {(t, /(t)) : 
t e E} is di compact subset of R^. Suppose first that / is continuous. 
The proof of Proposition 21.2 shows 7(5) = (5, f{s)) is a continuous 
function on so its image ^{E) = G is compact by Theorem 21.4(i). 

Now assume G is compact, but / is not continuous at to in E. 
Then there exists an e > 0 and a sequence (t^) in E such that 

limt^ = to and - /(to)| > e for all n. (1) 

n 

Since G is a bounded set, the Bolzano- Weierstrass Theorem 13.5 
shows (t^, f{tn)) has a convergent subsequence (t^^, f{tnk))' Its limit 
is in G, because G is closed in R^ by the Heine-Borel Theorem 13.12. 
Thus there exists t in so that lim/^(t^^, /(t^^)) = (t^f{t)). Since 
liuintn = to, we have t = to, and therefore limjt(t^^, /(t^J) = 
{tojf{to))- III particular, limkf{tnj^) = /(to), which contradicts the 
inequality in (1). 

Mark Lynch [44] uses the fact above to give a very interesting 
construction of a continuous nowhere-differentiable function on a 
closed interval [0, 1]; see his construction on page 361. □ 

21.6 Remark. 

The remainder of this section will be devoted to the Baire Cate- 
gory Theorem and some interesting consequences. We will need some 
metric-space terminology, some of it from §13. Let (5, d) be a metric 
space. For a subset E of 5, its complement is S\E = {s ^ S : s ^ E}. 
A point s is in the interior of a set E, or interior to E, if s E V C. E 
for some open subset V oi S. A subset E oi S is closed ii S \ E is 
open. A point s is in the closure of a set E if every open set con- 
taining s also contains an element of E. We write E~ for the set of 
points in the closure of E. 

A subset D of 5 is dense in S if every nonempty open set U 
intersects D, i.e., DnU ^ 0. For example, Q is dense in R, since every 
nonempty open interval in R contains rationals; see 4.7 on page 25. 
Finally, a totally new definition: a subset of 5 is nowhere dense in 
S if its closure E~ has empty interior. Obviously E is nowhere dense 
if and only if E~ is nowhere dense. Also, E is nowhere dense in S if 
and only if S \ E~ is dense in S. 
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Each part of the next theorem is a variant of what is cahed the 
Baire Category Theorem. After that theorem, we wih give the ulti- 
mate version of this theorem and explain the terminology "category." 
Just as in Example 4 on page 88, open balls Br{xo) = {x G 5 : 
(i(x,xo) < r} in. S are open sets, and closed balls Cj.(xo) = {x ^ S : 
d{x,XQ) < r} are closed sets. Note Cs{xo) C Br{xo) for s < r. 

21.7 Theorem. 

Let {S, d) he a complete metric space. Then 

(a) // {Un) is a sequence of dense open subsets of S, then the 
intersection X = {~]^^^Un is dense in S. 

(b) // (Fn) is a sequence of closed subsets of S and if the union 
F = U^^iFn contains a nonempty open set, then so does at 
least one of the sets F^. 

(c) The union of a sequence of nowhere dense subsets of S has dense 
complement. 

(d) The space S is not a union of a sequence of nowhere dense 
subsets of S. 

Proof 

All the hard work will be in proving: Part (a). Consider a nonempty 
open subset V of S] we need to show X {^V ^ 0. Since Ui is open 
and dense and V is open, Ui^V is open and nonempty. So there 
exists xi ^Uir\V and ri < 1 so that Cr-^ (xi) C Uir\V . Since U2 is 
open and dense and Br^{xi) is open, there exists X2 G Br^{xi) Pi U2 
and r2 < ^ so that 07^2(^2) ^ ^ri(^i) H Continuing, we obtain 
sequences {x^) in S and positive numbers {r^) so that 

Xk+i e Br^{xk), rk < and C^^^,(xfc+i) C Br^{xk) H Uk^i. 

Note d{xkjXk^i) < rk for all A;, so for m < n we have 

n—1 n—1 ^ 00 ^ ^ 

diXm,Xn) < J2 dixk,Xk+l) < J2 ^ < J2 ^ = 

k=ni k=ni k=nn 

Thus the sequence {x^) is a Cauchy sequence in S. Since S is 
complete, we have lim^^ Xk — x for some x ^ S. Since we have 

Xk ^ Crj^iXk) ^ Cr^{Xn) for k > 
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and since Cr^{xn) is closed, x also belongs to Cr^. This is true for 
all n, so 

oo CX) 
n=l n=l 

Since we also have x G C^i(xi) C V, we conclude x G X H y, as 
desired. 

Part (b). Suppose U^;^^^ has nonempty interior. Then S \ 
U^^F^ = 0^/(5 \ Fn) is not dense in S. Since the sets S \ 
are open, part (a) shows that at least one of them, say S \ F^, is 
also not dense in S. Thus its complement contains a nonempty 
open set. 

Part (c). Let A = W^^iAn be the union of a sequence of nowhere 
dense sets A^. We need to show the complement of A, S \ A, is 
dense in S. If we replace each by its closure, they will still be 
nowhere dense and S \A only gets smaller. In other words, we may 
assume each A^ is closed and nowhere dense. Part (b) implies that 
A contains no nonempty open set. Thus every nonempty open set 
intersects S \A^ and 5 \ A is dense in S. 

Part (d). This is obvious from part (c), since the complement of 
S is the empty set 0. ■ 

Theorem 21.7 tells us in different ways that the union of a se- 
quence of nowhere dense subsets of a complete metric space is small 
relative to the size of S. For this reason, it is common to divide the 
subsets of S into two categories. Category 1 consists of sets that are 
unions of sequences of nowhere dense subsets of 5, and Category 2 
consists of the other subsets of S. Here is part (d) of Theorem 21.7 
restated using this language. 

21.8 Baire Category Theorem. 

A complete metric space {S, d) is of the second category in itself. 

The expression "in itself" here deserves a comment. Many topo- 
logical properties about sets ECS depend on the set S. For 
example, the set (0, 1] is not closed in 5 = M, but it is closed in 
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S = (0, oo) viewed as a metric space. Category is another prop- 
erty that depends on S, so "in itself" in Theorem 21.8 stresses the 
reference to the complete metric space S} 

21.9 Corollary. 

Each of the spaces is of second category in itself 
Example 7 

Any set that can be listed as a sequence is said to be "countable." 
Other sets are "uncountable." 

(a) Countable unions of sets of first category are sets of first cate- 
gory. For example, countable subsets of R, and more generally 
of R^, are of first category, since single points {x} in these 
spaces are nowhere dense. This and Corollary 21.9 give another 
(rather heavy-handed) proof that R is uncountable; compare 
Exercise 16.8. 

(b) Example 3 on page 70 shows the set Q of rationals is countable. 
Thus Q is of first category in R, and the set of irrationals is of 
second category in R. 

(c) Each straight line in the plane R^ is of first category in R^, so 
a countable union of straight lines is of first category in R^. □ 

21.10 Discussion. 

A closed set in a metric space is said to be perfect if every point 
X in is the limit of a sequence of points in \ {x}; compare 
Proposition 13.9(b). This proposition also shows closed subsets of 
complete metric spaces are themselves complete metric spaces. In 
a perfect subset of a complete metric space, single points are 
nowhere dense in so countable subsets of E are of first cate- 
gory. Therefore, nonempty perfect subsets of complete metric spaces 
are uncountable. The Cantor set (in Example 5 on page 89) is an 
interesting compact perfect set. □ 

Recall Exercise 17.14, where a function on R is described that is 
continuous at each irrational and discontinuous at each rational. In 



^One of the fine properties of compactness is: If a set is compact in some set, 
then it is compact in all sets. 
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the next example, we will show there are no functions on R that are 
continuous at only the rationals. 

Example 8 

(a) Consider any function / on R. For each x in R, let 

Uf{x) = inf sup{|/(^) - f{z)\ :y,z e{x- 6,x + 6)}. 

0>{J 

The function cjf is the "oscillation function" of /. The function 
/ is continuous at x if and only if = 0; see Exercise 21.13. 

We show each set {x G R : < e} is open in R; e > 0. 

Suppose (jjf{x()) < e; we need to show this inequality holds in 
an interval containing xq. By the definition, there exists 6 > 0 
such that 

sup{|/(^) - f{z)\ :y,z e {xq- 6,xo + 6)} < e. 

For X G (xq — |,xo + |) we have (x— C (xq — 5, + 

and therefore 

ujf{x) <sup||/(^)-/(z)| :y,ze (^"^'^+0} 

< sup{|/(^) - f{z)\ :y,z e {xo- 6,xo + 6)} < e. 

(b) There is no function / on R that is continuous only on the set 
Q of rational numbers. Otherwise, by part (a) the equality 

Q = {x G R : 0Jf{x) = 0} = Pi |x G R : cjf{x) < -\ 

n=l ^ ^ 

would express Q as the intersection of a sequence of open 
subsets of R, contrary to Exercise 21.11. □ 

21.11 Theorem. 

No nondegenerate interval I in W can be written as the disjoint 
union of two or more nondegenerate closed intervals. (An interval 
is ''nondegenerate^^ if it has more than one point.) 

Proof 

We prove the theorem for / = [a, 6], a < 6, and leave the other cases 
to Exercise 21.14. Assume / is the disjoint union of two or more 
nondegenerate closed intervals. It is clear there are infinitely many 
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such intervals, because otherwise they could be listed in order, and 
there would be points in / between the first and second interval. 
It is also clear that the family can be listed as a sequence (i.e., is 
countable), since there is a one-to-one function from the collection 
of disjoint intervals into Q. 

So we assume / = U^-[^[a^, bk]. By Discussion 13.7(iii) on page 87, 
the union ^^lia^^bk) is open, so that K = I\[J^^{ak,bk) is closed. 
Then K is the set of endpoints of the removed intervals, so K is 
nonempty and countable. We will show K is perfect, and this will 
be a contradiction by Discussion 21.10. Consider x in K] we may 
assume x ^ b. Consider an interval [x^x + K) where /i > 0. Some 
closed interval [a^,6^] must intersect + and [a^,6^] cannot 
contain x in K. Thus x < am < x + h. Since is in K, the interval 
+ h) intersects and since /i > 0 is arbitrary, x is a limit of 
points in K\{x}. This shows K is perfect, completing the proof. ■ 

A close examination of Example 8(b) and Theorem 21.11 shows 
they both depend on the Baire Category Theorem 21.8. Other ap- 
plications of this theorem appear in Theorem 38.3 and twice in 
Theorem 38.5. 

Exercises 

21.1 Show that if the functions /i, /2, • • • , //c in Proposition 21.2 are 
uniformly continuous, then so is 7. 

21.2 Consider f:S S* where {S,d) and {S*,d*) are metric spaces. 
Show that / is continuous at sq G 5' if and only if 

for every open set U in 5'* containing /(sq), there is 
an open set V in S containing sq such that f{V) C U. 

21.3 Let (5*, d) be a metric space and choose sq G 5'. Show f{s) = d{s^ sq) 
defines a uniformly continuous real- valued function f on S. 

21 A Consider f:S-^R where (5*, d) is a metric space. Show the following 
are equivalent: 

(i) / is continuous; 

(ii) f~^{{a, b)) is open in S for all a < b; 

(iii) f~^{{a, b)) is open in S for all rational a <b. 
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21.5 Let E he Si noncompact subset of R . 

(a) Show there is an unbounded continuous real-valued function 
on E. Hint: Either E is unbounded or else its closure E~ 
contains Xq ^ E. In the latter case, use ^ where g{x) = 
d{x,Xo). 

(b) Show there is a bounded continuous real- valued function on E 
that does not assume its maximum on E. 

21.6 For metric spaces (5'2,<^2), (S'a, c^a), prove that if /: S'l ^ ^2 
and g: S2 Ss are continuous, then go f is continuous from S'l into 
S3. Hint: It is somewhat easier to use Theorem 21.3 than to use the 
definition. 

21.7 (a) Observe that if E C S where (S^d) is a metric space, then 

{E^ d) is also a metric space. In particular, if £^ C R, then 
(i(a, h) = \a — h\ for a^b ^ E defines a metric on E. 

(b) For 7: [a, b] ^ R^, give the definition of continuity of 7. 

21.8 Let {S,d) and be metric spaces. Show that if /: 5' ^ 5'* is 
uniformly continuous, and if {sn) is a Cauchy sequence in S', then 
{f{sn)) is a Cauchy sequence in S**. 

21.9 We say a function / maps a set E onto a set F provided f{E) = F. 

(a) Show there is a continuous function mapping the unit square 

{{xi,X2) G R^ : 0 < < 1,0 < X2 < 1} 

onto [0,1]. 

(b) Do you think there is a continuous function mapping [0, 1] onto 
the unit square? 

21.10 Show there exist continuous functions 

(a) Mapping (0,1) onto [0,1], 

(b) Mapping (0,1) onto R, 

(c) Mapping [0, 1] U [2, 3] onto [0, 1]. 

(d) Explain why there are no continuous functions mapping [0, 1] 
onto (0, 1) or R. 

21.11 Show the set Q of rational numbers is not the intersection of a 
sequence of open sets, so that the set R \ Q of irrational numbers is 
not the union of a sequence of closed subsets of R. 
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21.12 Give an example of an infinite disjoint sequence of subsets of R, each 
of which is of second category in M. 

21.13 Let ujf he the oscihation function in Example 8(a). Show that / is 
continuous at x in M if and only if ojf{x) = 0. 

21.14 Complete the proof of Theorem 21.11. Hint: Assume a nondegener- 
ate interval / in R is the union of two or more disjoint nondegenerate 
closed intervals. Select points x < y in /, so that they are interior to 
two distinct such subintervals. Show [x, y] is also the union of two or 
more disjoint nondegenerate closed intervals, contradicting the case 
covered in the proof of Theorem 21.11. 
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Consider a subset of R that is not an interval. As noted in the 
proof of Corollary 18.3, the property 

yi,y2 e E and yi < y < y2 imply y e E 

must fail. So there exist yi,y2,y in R such that 

2/1 < 2/ < 2/2, yi,y2^E, y^E. (*) 

The set E is not "connected" because y separates E into two pieces. 
Put another way, if we set Ui = (— oo,^) and U2 = (^,00), then we 
obtain open sets so that EnUi and EnU2 are disjoint nonempty sets 
who union is E. The last observation can be promoted to a useful 
general definition. 

22.1 Definition. 

Let be a subset of a metric space (5, d). The set E is disconnected 
if one of the following two equivalent conditions holds, 
(a)^ There are open subsets Ui and U2 of S such that 

{E n Ui) n n c/2) = 0 and E = {EnUi)u{En U2), (i) 

EnUi^0 and EnU2^0. (2) 



^Readers familiar with relative topologies will recognize this as stating that E is 
a disjoint union of nonempty relatively-open subsets of E. 
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(b) There are disjoint nonempty subsets A and B of E such that 
E = AU B and neither set intersects the closure of the other 
set, i.e., 

A~ DB = 0 and AnB~ = 0. (3) 
A set E is connected if it is not disconnected. 

Remark. We show that conditions (a) and (b) above are 
equivalent. 

If (a) holds, set A = E nUi d^nd B = E nU2. To check (b), we 
need only verify (3). If, for example, A~ H 5 ^ 0, then there exists 
b e A~nB CU2,so there is r > 0 so that {s e S : d{s, b) < r} C U2. 
Since b is in A", Proposition 13.9(c) shows there is a in A such that 
d{a, b) < r. But then a G H = 5, a contradiction, since A and 
B are disjoint. Thus (3) holds, and condition (b) holds. 

Now suppose that (b) holds. Let Ui = S\B- and 1/2 = S\A-. 
To verify (a), it suffices to show E O Ui = A and E O U2 = B. 
For example, x ^ E H Ui implies x ^ S \ B implies x ^ B. Since 
X ^ AU B, we conclude x ^ A. Finally, if x G A, then x ^ B~ 
by (3), so X G 5 \ B~ = Ui. Therefore x is in H i7i. We've shown 
EnUi=A. 

Example 1 

As noted before the definition, sets in R that are not intervals are 
disconnected. Conversely, intervals in M are connected. To prove this 
from the definition, we will assume the contrary and obtain a con- 
tradiction. So we assume there is an interval / and open sets Ui and 
U2 disconnecting / as in Definition 22.1(a). Select a ^ I HUi and 
6 G / n 1/2- We may suppose a < b. Now the interval [a, 6] satisfies 
the same conditions in Definition 22.1(a) as /. So we may assume 
/ = [a, 6], a G and b G 1/2- 

Let t = sup[a, 6) n [/i, so that t > a. Since (6 — e,6] C U2 for some 
e > 0, we also have t < 6. If t is in f/i, then [t, t + e) C [/^ Pl [a, b] 
for some e > 0, but then t = sup[a, b) D Ui > t + e. li t e 1/2^ then 
(t — e, t] C n [a, 6], which would imply t = sup[a, b) DUi < t — e. 
Each possibility leads to a contradiction, so [a, b] and the original 
interval / are connected. □ 
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22.2 Theorem. 

Consider metric spaces {S,d), (5*,^*); and let f-.S^S"" be con- 
tinuous. If E is a connected subset of S, then f{E) is a connected 
subset of 5*. 

Proof 

Assume f{E) is not connected in 5*. Then there exist open sets Vi 
and V2 in S'* such that 

{f{E) n Vi) n {f{E) n V2) = 0, f{E) = {f{E) n ^i) u {f{E) n ^2), 

f{E) n ^1 ^ 0 and f{E) H ^2 / 0- 

Let [/i = f-^{Vi) and ^72 = f~^{V2)- Then i7i and [/2 are open 
sets in S that separate E as in Definition 22.1(a). Thus E is not 
connected, a contradiction. ■ 

The next corollary generalizes Theorem 18.2 and its corollary. 

22.3 Corollary. 

Let f be a continuous real- valued function on a metric space (S^d). 
If E is a connected subset of S, then f{E) is an interval in R. In 
particular, f has the intermediate value property. 

Example 2 

Curves are connected. That is, if 7 is a path in as described in 
Example 3 of §21, page 165 and / is a subinterval of R, then the 
image 7(1) is connected in R^. □ 

22.4 Definition. 

A subset of a metric space (5, d) is said to be path- connected if, 
for each pair 5,t of points in E^ there exists a continuous function 
7: [a, b] ^ E such that 7(a) = s and 7(6) = t. We call 7 a path. 

22.5 Theorem. 

If E in (S^d) is path-connected, then E is connected. [The failure of 
the converse is illustrated in Exercise 22.4] 

Proof 

Assume E is disconnected by open sets Ui and C/2: 

{EnUi)n{EnU2) = 0 and E = {EnUi)U{EnU2), (1) 
EnUi^0 and £; H C/2 / 0. (2) 
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FIGURE 22.1 



Select s ^ E nUi and t ^ E nU2. Let 7: [a, 6] ^ be a path where 
7(a) = s and 7(6) = t. Let F = 7([a,6]). Then (1) and (2) hold 
with F in place of E. Thus F is disconnected, but F is connected by 
Theorem 22.2. ■ 

Figure 22.1 gives a path-connected set and a disconnected set 
in R2. 

Example 3 

Many familiar sets in such as the open ball {x : d{x, 0) < r}, the 
closed ball {x : d{x,0) < r} and the fc-dimensional cube 



{x : max{|xj| : j = 1, 2, . . . , A;} < 1} 
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are convex. A subset E of is convex if 

x,y e E and 0 < t < 1 imply tx + {1 - t)y G E, 

i.e., whenever contains two points it contains the hne segment 
connecting them. See Fig. 22.1. Convex sets E in are always 
path-connected. This is because 7(t) = tx + {1 — t)y defines a path 
7: [0, 1] ^ E such that 7(0) = y and 7(1) = x. For more details, see 
any book on several variable calculus. □ 

Example 4 

This example is adapted from [15]. Suppose / is an interval in R 
and / : / ^ R is a function with graph G = : x G /}. 

Then / is continuous if and only if G is path-connected. Note 
that "path-connected" here cannot be changed to "connected;" see 
Exercise 22.13. 

If / is continuous, then for each (a, /(a)) and (6, f{h)) in G, ^{t) = 
(t, f{t)) is a path connecting these points. Note that 7 is continuous 
by Proposition 21.2. 

For the converse, assume G is path-connected. Consider a, 6 in / 
where a < b. Since G is path-connected, there is a continuous func- 
tion 7 : [0, 1] ^ G satisfying 7(0) = (a, /(a)) and 7(1) = (6, f{b)). By 
Proposition 21.2, we can write 7(t) = {x{t),y{t)) where x and y are 
continuous real- valued functions on [0, 1]. Of course, y{t) = f{x{t)) 
for all t. First, we claim 

{{zJ{z)):ze[a,b]}C^i[0,l]). (1) 

Since x{t) is continuous on [0,1], x{0) = a and x{l) = 6, the 
Intermediate Value Theorem 18.2 for continuous functions shows 
that if z is in (a, 6), then x{t) = z for some t G (0,1). Thus 
{z^f{z)) = = 7(^)- Since the cases z = a and z = b 

are trivial, this implies (1). 

Next we show / satisfies IVP, the intermediate value property: 
(IVP) If a,6 G /, a < 6 and c is between /(a) and f{b), then 
f{x) = c for some x G [a, 6]. 

Let a = sup{t G [0, 1] : x{t) < a} and /3 = inf {t G [0, 1] : 
x{t) > b}. Thus 0 < a < 13 < 1. Since is continuous, we see 
that x([«,/3]) = [a, 6]. Now we apply the Intermediate Value Theo- 
rem again, this time to f{x{t)) on [«,/3]. Since f{x{a)) = /(a) and 
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= f{b), we have f{x{t)) = c for some t in For this t 

we have x{t) G [a, 6], so we have verified IVP. 

Now assume / is not continuous on /. Then there exists xq G /, 
6 > 0, and a sequence (xn) in / that converges to xq satisfying 
\f{xn) - f{xo)\ > e for all n. Then f{xn) > f{xo) + e > /(xq) for 
infinitely many n, or else f{xn) < f{xo) — e < f{xo) for infinitely 
many n. Passing to a subsequence, we may assume f{xn) > f{xo) + 
e > f{xo) for all n, say. By the IVP, for each n there is i/n between 
Xji and Xq so that f{yn) — /(^o) + ^- Then (t/^, f{yn)) is a sequence 
in G satisfying 

lim^^ = xo and lim(2/n, /(^/n)) = (^o, /(^o) + e). (2) 

Moreover, there exist a < 6 in / such that xq and all i/n belong to 
[a, 6]. We apply (1) to this a and b and 7 described there. So, for each 
n G N there exists tn G [0, 1] so that 7(t^) = fiVn))' Passing to 
a subsequence {tnj^)keN of (^n)? we may assume that lim^^ = to for 
some to in [0, 1]. Since 7 is continuous, we conclude from (2) that 

7(to) =lim7(t^J = lim(^^^,/(^^J) = (xq, /(xq) + e). 

k k 

Since this limit is not in G, and 7([0, 1]) C G, we have a contradiction 
and / is continuous on /. □ 

We end this section with a discussion of some very different metric 
spaces. The points in these spaces are actually functions themselves. 

22.6 Definition. 

Let 5 be a subset of M. Let C{S) be the set of all bounded continuous 
real- valued functions on S and, for f,g ^ C{S), let 

d{f,g) = sup{|/(x) - g{x)\ : X e S}. 

With this definition, C{S) becomes a metric space [Exercise 22.6]. 
In this metric space, a sequence (/^) converges to a point [function!] 
/ provided lim^^oo /) = 0, that is 

hm sup{\fn{x)-f{x)\:xeS} = 0. (*) 

Put another way, for each e > 0 there exists a number N such that 

\fn{x) — f{x)\ < e for all x ^ S and n > N. 
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We will study this important concept in the next chapter, but 
without using metric space terminology. See Definition 24.2 and 
Remark 24.4 where (*) is called uniform convergence. 

A sequence (/^) in C{S) is a Cauchy sequence with respect to 
the metric d exactly when it is uniformly Cauchy as defined in Defi- 
nition 25.3. In our metric space terminology, Theorems 25.4 and 24.3 
tell us that C{S) is a complete metric space. 

Exercises 

22.1 Show there do not exist continuous functions 

(a) Mapping [0, 1] onto [0, 1] U [2,3], 

(b) Mapping (0, 1) onto Q. 

22.2 Show {{xi,X2) G : + ^2 = 1} is a connected subset of R^. 

22.3 Prove that if £^ is a connected subset of a metric space (5', d), then 
its closure E~ is also connected. 

22.4 Consider the following subset of R^: 




E is simply the graph of g{x) = sin ^ along the interval (0, 1]. 

(a) Determine its closure E~ . See Fig. 19.4. 

(b) Show E~ is connected. 

(c) Show E~ is not path-connected. 

22.5 Let E and F be connected sets in some metric space. 

(a) Prove that if E H F 0^ then E U F is connected. 

(b) Give an example to show E n F need not be connected. 
Incidentally, the empty set is connected. 

22.6 (a) Show C{S) given in Definition 22.6 is a metric space. 

(b) Why did we require the functions in C{S) to be bounded when 
no such requirement appears in Definition 24.2? 

22.7 Explain why the metric space B in Exercise 13.3 can be regarded 
as C(N). 
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22.8 Consider C{S) for a subset S of R. For a fixed sq in 5, define F{f) = 
f{so). Show F is a uniformly continuous real- valued function on the 
metric space C{S). 

22.9 Consider f,g e C{S) where SCR. Let F{t) = + (1 - t)g. Show 
F is a uniformly continuous function from R into C{S). 

22.10 Let / be a (fixed) uniformly continuous function in C(R). For each 
X G R, let fx be the function defined by fx{y) = f{x -\- y) for y G R. 
Let F{x) = fx] show F is uniformly continuous from R into C(R). 

22.11 Consider C{S) where 5' C R, and let £ consist of all / in C{S) such 
that sup{|/(x)| : X ^ S} < 1. 

(a) Show £ is closed in C{S). 

(b) Show C{S) is connected. 

(c) Show £ is connected. 

22.12 Consider a subset £ of C{S), 5* C R. For this exercise, we say a 
function /o in £ is interior to £ if there exists a finite subset F of S 
and an e > 0 such that 

{/ e C{S) : \f{x) - Mx)\ <ehrx&F}C£. 

The set £ is open if every function in £ is interior to £. 

(a) Reread Discussion 13.7. 

(b) Show the family of open sets defined above forms a topology for 
C{S). Remarks. This topology is different from the one given 
by the metric in Definition 22.6. In fact, this topology does 
not come from any metric at all! It is called the topology of 
pointwise convergence and can be used to study the convergence 
in Definition 24.1 just as the metric in Definition 22.6 can be 
used to study the convergence in Definition 24.2. 

22.13 Let / be the function defined on [0, oc) by f{x) = (x,sin(l/x)) for 
X > 0 and /(O) = 0. Show that the graph of / is connected but not 
path-connected; compare Exercise 22.4. Is / continuous on [0, oc)? 

22.14 Consider a bounded sequence {sn) in R and its set S of subsequential 
limits as in Theorem 11.8. Show that if\imn{sn-\-i—Sn) = 0, then S is 
a connected interval in R. This is from [11]. Hint: Consider a < c < b 
where a and b are in and show c is in 5*. Use Theorem 11.2. 
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CHAPTER 



Sequences and 
Series of 
Functions 



In this chapter we develop some of the basic properties of power se- 
ries. In doing so, we will introduce uniform convergence and illustrate 
its importance. In §26 we prove power series can be differentiated and 
integrated term-by-term. 



§23 Power Series 

Given a sequence (a^)^Q of real numbers, the series X^^q ^nX^ is 
called a power series. Observe the variable x. Thus the power series 
is a function of x provided it converges for some or all x. Of course, 
it converges for x = 0; note the convention 0^ = 1. Whether it 
converges for other values of x depends on the choice of coefficients 
(an)' It turns out that, given any sequence (a^), one of the following 
holds for its power series: 

(a) The power series converges for all x G R; 

(b) The power series converges only for x = 0; 

(c) The power series converges for all x in some bounded interval 
centered at 0; the interval may be open, half-open or closed. 

K.A. Ross, Elementary Analysis: The Theory of Calculus, 187 
Undergraduate Texts in Mathematics, DOI 10.1007/978-l-4614-6271-2_4, 
© Springer Science+Business Media New York 2013 
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These remarks are consequences of the fohowing important 
theorem. 

23.1 Theorem. 

For the power series ^anx'^, let 

/3 = hmsup la^l"*^/^ and R=—. 

[If ^ = 0 we set R = +00^ and if ^ = +00 we set R = 0.] Then 
(i) The power series converges for \x\ < R] 
(ii) The power series diverges for \x\ > R. 

R is cahed the radius of convergence for the power series. Note 
that (i) is a vacuous statement if i? = 0 and that (ii) is a vacuous 
statement if i? = +00. Note also that (a) above corresponds to the 
case R = +00, (b) above corresponds to the case i? = 0, and (c) 
above corresponds to the case 0 < i? < +00. 

Proof of Theorem 23.1 

The proof follows quite easily from the Root Test 14.9. Here are the 
details. We want to apply the Root Test to the series ^ a^x^. So for 
each X G M, let ax be the number or symbol defined in 14.9 for the 
series ^ a^x^. Since the nth term of the series is a^x^, we have 

ax = limsup \anX^\^^'^ = limsup IxHanl"*"^^ = \x\ • limsup lanl"*"^^ = P\x\. 

The third equality is justified by Exercise 12.6(a). Now we consider 
cases. 

Case 1. Suppose 0 < i? < +00. In this case ax = li\x\ — 
li \x\ < R then < 1, so the series converges by the Root Test. 
Likewise, if \x\ > i?, then ax > 1 and the series diverges. 

Case 2. Suppose R = +oc. Then /3 = 0 and ax = 0 no matter 
what X is. Hence the power series converges for all x by the Root 
Test. 

Case 3. Suppose i? = 0. Then /3 = +00 and ax = +00 for x 7^ 0. 
Thus by the Root Test the series diverges for x 7^ 0. 
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Recall that if lim \ ^^^^ \ exists, then this limit equals /3 of the last 
theorem by Corollary 12.3. This limit is often easier to calculate than 
lim sup la^l-*^/^; see the examples below. 

Example 1 

Consider . A^""- If = A, then ^ = so lim 1^1 = 0. 

Z-^n=\j n\ n\ ' an n-\-l ' i an ' 

Therefore /3 = 0, i? = +00 and this series has radius of convergence 
+00. That is, it converges for all x in R. In fact, it converges to 
for all X, but that is another story; see Example 1 in §31, page 252, 
and also §37. □ 

Example 2 

Consider X^^q^^* Then (5 — 1 and R = 1. Note this series does 
not converge for x = 1 or x = — 1, so the interval of convergence is 
exactly (—1,1). [By interval of convergence we mean the set of x for 
which the power series converges.] The series converges to by 
formula (2) of Example 1 in §14, page 96. □ 

Example 3 

1 

Consider X^^q n^^' Since lim = 1, we again have /3 = 1 and 

n 

i? = 1. This series diverges for x = 1 [see Example 1 of §15], but 
it converges for x = —1 by the Alternating Series theorem 15.3 on 
page 108. Hence the interval of convergence is exactly [—1,1). □ 

Example 4 

Consider X^^q Once again /3 = 1 and i? = 1. This series 

converges at both x — 1 and x = —1, so its interval of convergence 
is exactly [—1,1]. □ 

Example 5 

The series X^^q ^'^^ has radius of convergence R — 0 because we 
have lim | ^^t^P' \ = +00. It diverges for every x ^ 0. □ 



Examples 1-5 illustrate all the possibilities discussed in (a)-(c) 
prior to Theorem 23.1. 
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Example 6 

Consider X^^q 2~^x^^. This is deceptive, and it is tempting to cal- 
culate /3 = limsup(2~^)-'^/^ = ^ and conclude i? = 2. This is wrong 
because is the coefficient of x^^ not x^, and the calculation of 
/3 must involve the coefficients of x'^. We need to handle this 
series more carefully. The series can be written y^^?_Q Qj^x^ where 
ask = 2~^ and = 0 if n is not a multiple of 3. We calculate /3 
by using the subsequence of all nonzero terms, i.e., the subsequence 
given by a{k) = 3k. This yields 

^ = limsup |a^|^/^ = lim \a3k\^^^^ = lim (2-^)^3^ = 2"^/^ 

k^oo k^oo 

Therefore the radius of convergence is i? = 4 = 2^^^. □ 



One may consider more general power series of the form 

oo 

J2(^n{x-Xor, (*) 

n=0 

where xq is a fixed real number, but they reduce to series of the 
form X^^o ^nU^ by the change of variable y = x — xq. The interval 
of convergence for the series (*) will be an interval centered at xq. 



Example 7 

Consider the series 



j:tlL(.-ir. (1) 

n=l 



The radius of convergence for the series J2^=i ^~^n ^ is i? = 1, so 
the interval of convergence for the series (1) is the interval (0, 2) plus 
perhaps an endpoint or two. Direct substitution shows the series (1) 
converges at x = 2 [it's an alternating series] and diverges to — oo at 
X = 0. So the exact interval of convergence is (0, 2]. It turns out that 
the series (1) represents the function logg x on (0, 2]. See Examples 1 
and 2 in S26. □ 



§23. Power Series 





-1 



fl 



-1 



/2 



-1 I 

fs 



FIGURE 23.1 



On of our major goals is to understand the function given by a 
power series 



We are interested in questions like: Is / continuous? Is / differen- 
tiable? If so, can one differentiate / term-by-term: 



Can one integrate / term-by-term? 

Returning to the question of continuity, what reason is there to 
believe / is continuous? Its partial sums fn = ^k=o ^k^^ contin- 
uous, since they are polynomials. Moreover, we have lim^^oo fn{x) = 
f{x) for \x\ < R. Therefore / would be continuous if a, result like 
the following were true: If (fn) is a sequence of continuous functions 
on (a, 6) and if lim^^oo /n(^) — f{x) for all x G (a, 6), then / is 
continuous on (a, 6). However, this fine sounding result is false! 

Example 8 

Let fnlx) = (1 - |x|)^ for x e (-1,1); see Fig. 23.1. Let f{x) = 0 
for X ^ 0 and let /(O) = 1. Then we have lim^^oo/n(^) = f{x) 
for all X G (—1,1), since liuin^^a^ = 0 if \a\ < 1. Each is a 
continuous function, but the limit function / is clearly discontinuous 
at X = 0. □ 
This example, as well as Exercises 23.7-23.9, may be discourag- 
ing, but it turns out that power series do converge to continuous 



oo 



f(^x) = ^^akX^ for \x\ < R. 



k=o 



oo 



f\x) = ^kakx' 
k=i 



,k-l 7 
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functions. This is because 

n oo 

lim 7^ akX^ converges uniformly to 7^ akX^ 

on sets [— such that R\ < R. The definition of uniform con- 
vergence is given in the next section, and the next two sections will 
be devoted to this important notion. We return to power series in 
§26, and again in §31. 



Exercises 

23.1 For each of the following power series, find the radius of convergence 
and determine the exact interval of convergence. 

(a)E^'^" (b)E(f)" 
(c) (d) E(i^K 

(e) E(f (f) E((^^+^)^" 

(g) E(^S^)^" (h) E(fe^)^" 

23.2 Repeat Exercise 23.1 for the following: 
(a)ExA^a;" (b)E^x" 

(c) E^"' (d)ES^'"^' 

23.3 Find the exact interval of convergence for the series in Example 6. 

23.4 For n = 0, 1, 2, 3, . . ., let = [ ^+^(-^)" ]^. 

(a) Find limsup(an)^^^, liminf (a^)^^^, limsup|^^^| and liminf 

I an I 

(b) Do the series and ^(— l)^an converge? Explain briefly. 

(c) Now consider the power series ^ a^x^ with the coefficients 

as above. Find the radius of convergence and determine the 
exact interval of convergence for the series. 

23.5 Consider a power series ^ a^^^ with radius of convergence R. 

(a) Prove that if all the coefficients are integers and if infinitely 
many of them are nonzero, then R <\. 

(b) Prove that if lim sup \an\ > 0, then R < 1. 
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23.6 (a) Suppose cinX^ has finite radius of convergence R and > 0 

for all n. Show that if the series converges at i?, then it also 
converges ai —R. 

(b) Give an example of a power series whose interval of convergence 
is exactly ( — 1,1]. 

The next three exercises are designed to show that the notion of 
convergence of functions discussed prior to Example 8 has many 
defects. 

23.7 For each n G N, let fn{x) = (cosx)^. Each is a continuous 
function. Nevertheless, show 

(a) limfn{x) = 0 unless x is a multiple of tt, 

(b) limfn{x) = 1 if X is an even multiple of tt, 

(c) \imfn{x) does not exist if x is an odd multiple of tt. 

23.8 For each n G N, let fn{x) = ^sinnx. Each fn is a differentiable 
function. Show 

(a) \im fn{x) = 0 for all x G M, 

(b) But lim/^(x) need not exist [at x = tt for instance]. 

23.9 Let fn{x) = nx^ for x G [0, 1] and n G N. Show 

(a) \im fn{x) = 0 for X G [0, 1). Hint: Use Exercise 9.12. 

(b) However, lim^^cx) Jq fn{x) dx = 1. 



§24 Uniform Convergence 

We first formalize the notion of convergence discussed prior to 
Example 8 in the preceding section. 

24.1 Definition. 

Let (fn) be a sequence of real-valued functions defined on a set 5 C 
R. The sequence (/^) converges pointwise [i.e., at each point] to a 
function / defined on S if 

lim fn{x) = f{x) for all x ^ S. 

We often write lim/^ = / pointwise [on S] or ^ / pointwise 
[on S]. 
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Example 1 

All the functions / obtained in the last section as a limit of a se- 
quence of functions were pointwise limits. See Example 8 of §23 and 
Exercises 23.7-23.9. In Exercise 23.8 we have /n ^ 0 pointwise on 
R, and in Exercise 23.9 we have fn^O pointwise on [0, 1). □ 

Example 2 

Let fn{x) = x'^ for x G [0, 1]. Then fn^f pointwise on [0, 1] where 
f(x) = OfoT xe [0, 1) and /(I) = 1. □ 

Now observe fn^f pointwise on S means exactly the following: 

for each e > 0 and x in S there exists N such that . . 

\fn{x)- f{x)\<e for n>N. ^' 

Note the value of N depends on both e > 0 and x in S. If for each 
e > 0 we could find so that 

\fn{x) — f{x)\ < e for all x ^ S and n > N, 

then the values fn{x) would be "uniformly" close to the values f{x). 
Here N would depend on e but not on x. This concept is extremely 
useful. 

24.2 Definition. 

Let (fn) be a sequence of real-valued functions defined on a set 
5 C R. The sequence (/^) converges uniformly on S to a, function / 
defined on S if 

for each e > 0 there exists a number such that 
\fn{x) - f{x)\ < e for all X G 5 and ah n > A^. ^ ^ 

We write lim fn — f uniformly on S oi fn ^ f uniformly on S. 

Note that if fn ^ f uniformly on S and if e > 0, then there exists 
A^ such that f{x) — e < fn{x) < f{x) + e for all x ^ S and n > N. 
In other words, for n > N the graph of fn lies in the strip between 
the graphs of / — e and / + e. In Fig. 24.1 the graphs of fn ioi n > N 
would all lie between the dotted curves. 

We return to our earlier examples. 
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FIGURE 24.1 



Example 3 

Let fn{x) = (l-|x|)^ forx G (-1,1). Also, let f{x) = 0 for x ^ 0 and 
/(O) = 1. As noted in Example 8 of §23, fn^f pointwise on (—1, 1). 
It turns out that the sequence (/^) does not converge uniformly to 
/ on (—1,1) in view of the next theorem. This can also be shown 
directly, as follows. Assume fn^f uniformly on (—1, 1). Then [with 
6 = ^ in mind] we see there exists in N so that \f{x) — fn{x)\ < \ 
for all X G ( — 1, 1) and n > N. Hence 

xg(0, 1) and n>N imply |(l-x)''|<^. 
In particular, 

X G (0, 1) implies (1 - x)^+^ < ^. 

However, this fails for sufficiently small x; for example, if we set 
X = 1-2-1/(^+1), then 1-x = 2-V(^+i) and (l-x)^+i = 2'^ = \. 
This contradiction shows (/^) does not converge uniformly to / on 
(—1,1) as had been assumed. □ 

Example 4 

Let fn{x) — ^sinnx for x G M. Then fn ^ 0 pointwise on R as 
shown in Exercise 23.8. In fact, fn^O uniformly on R. To see this. 
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let e > 0 and let = ^. Then for n > and all x we have 

\fn{x)-0 

Example 5 

Let fn{x) nx'' for x G [0,1). Since lim^^oo lim^^oo ^ = 
+00, we have dropped the number 1 from the domain under consid- 
eration. Then fn^O pointwise on [0, 1), as shown in Exercise 23.9. 
We show the convergence is not uniform. If it were, there would exist 
in N such that 

Inx"^ - 0| < 1 for all x G [0, 1) and n> N. 

In particular, we would have {N + l)x^^^ < 1 for all x G [0,1). 
But this fails for x sufficiently close to 1. Consider, for example, the 
reciprocal x of (A^ + l)V(A^+i). □ 

Example 6 

As in Example 2, let fn{x) = x^ for x G [0,1], f{x) = 0 for x G 
[0, 1) and /(I) = 1. Then fn^f pointwise on [0, 1], but (/^) does 
not converge uniformly to / on [0, 1], as can be seen directly or by 
applying the next theorem. □ 

24.3 Theorem. 

The uniform limit of continuous functions is continuous. More pre- 
cisely, let (fn) be a sequence of functions on a set 5 C suppose 
fn ^ f uniformly on and suppose S = dom(/). // each fn is 
continuous at xq in S, then f is continuous at xq. [So if each fn is 
continuous on S, then f is continuous on S.] 

Proof 

This involves the famous "| argument." The critical inequality is 

\f{x) - f{xo)\ < \f{x) - U{X)\ + \fn{x) - fn{xo)\ + \fn{xo) ' f{xo)\. 

(1) 

If n is large enough, the first and third terms on the right side of (1) 
will be small, since fn^f uniformly. Once such n is selected^ the 
continuity of fn implies that the middle term will be small provided 
X is close to Xq. 



sm nx 



n 



1 1 

- n ^ TV 



e. 



□ 
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For the formal proof, let e > 0. There exists in N such that 

n > N implies \fn{x) — f{x)\ < ^ for all x ^ S. 

o 

In particular, 

\fN+i{x) - f{x)\ < ^ for all xeS. (2) 

Since /n+i is continuous at xq there is a 5 > 0 such that 

X e S and \x - xq] <6 imply |/iv+i(x) - /iv+i(xo)| < ^; (3) 

see Theorem 17.2. Now we apply (1) with n = + 1, (2) twice [once 
for X and once for xq] and (3) to conclude 

X ^ S and |x — xo| < S imply \f{x) — f{xo)\ < 3 • - = e. 

o 

This proves that / is continuous at xq. ■ 

One might think this theorem would be useless in practice, since 
it should be easier to show a single function is continuous than 
to show a sequence (/^) consists of continuous functions and the 
sequence converges to / uniformly. This would no doubt be true if 
/ were given by a simple formula. But consider, for example, 

(X) ^ 

/(x) = ^ — x"" for 

n=l 

or 

^ (-l)n(l^)2n 

Jq{x) = Y- — for xeR. 

The partial sums are clearly continuous, but neither / nor Jq is given 
by a simple formula. Moreover, many functions that arise in mathe- 
matics and elsewhere, such as the Bessel function Jq, are defined by 
power series. It would be very useful to know when and where power 
series converge uniformly; an answer is given in §26. 

24.4 Remark. 

Uniform convergence can be reformulated as follows. A sequence (/^) 
of functions on a set SCR converges uniformly to a function f on 
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S if and only if 

lim sup{|/(x)-/„(x)| :xG5} = 0. (1) 

We leave the straightforward proof to Exercise 24.12. 

According to (1) we can decide whether a sequence (/^) con- 
verges uniformly to / by calculating sup{|/(x) — fn{x)\ : x ^ S} for 
each n. If / — is different iable, we may use calculus to find these 
suprema. □ 



Example 7 

Let fn{x) = for x G R. Clearly we have lim^^oo /n(0) = 0. If 

X ^ 0, then lim^^oo(l + tix'^) — +00, so lim^^oo/n(^) — 0. Thus 
fn^O pointwise on R. To find the maximum and minimum of 
we calculate /^(x) and set it equal to 0. This leads to (1 + nx'^) • 1 
—x{2nx) = 0 or 1 — nx^ — 0. Thus fn{x) = 0 if and only if x = 
Further analysis or a sketch of leads one to conclude takes its 
maximum at -X= and its minimum at — ]=. Since L ( ±^ ) = ±77^, 
we conclude 

lim sup{|/^(x)| : X ^ S} = lim — — = 0. 
Therefore fn^O uniformly on R by Remark 24.4. □ 
Example 8 

Let fn{x) = n^x^{l—x) for x G [0, 1]. Then we have lim^^oo = 0. 
For X G [0, 1) we have lim^^oo ti^x^ = 0 by applying Exercise 9.12, 
since for x ^ 0, 



n^x'^ \ n 

Hence lim^^oo fn{x) = 0. Thus fn^O pointwise on [0, 1]. Again, to 
find the maximum and minimum of fn we set its derivative equal to 
0. We obtain x^(-l) + (1 - x)nx^-i = 0 or x^-^ [n - (n + l)x] = 0. 
Since fn takes the value 0 at both endpoints of the interval [0, 1], it 
follows that fn takes it maximum at We have 

n \ 2'^^'- n \ n I n 



n+1/ ^ V^ + lj V n+lj n + lV^ + l' ' 



Exercises \QQ 



The reciprocal of (^^)^ is (1 + ^)^, the nth term of a sequence which 
has hmit e. This was mentioned, but not proved, in Example 3 of §7; 
a proof is given in Theorem 37.11. Therefore we have lim(^^^)^ = ^. 

2 

Since lim[^^] = +00, we conclude from (1) that lim = +00; 

see Exercise 12.9(a). In particular, limsup{|/^(x)| : x G [0,1]} = 

+00, so (fn) does not converge uniformly to 0 on [0, 1]. □ 



Exercises 

24.1 Let fn{x) = 1+2^^^. Prove carefully that (fn) converges 
uniformly to 0 on M. 

24.2 For x G [0,oc), let fn{x) = f . 

(a) Find f{x) = \imfn{x). 

(b) Determine whether fn^f uniformly on [0, 1]. 

(c) Determine whether fn^f uniformly on [0, 00). 

24.3 Repeat Exercise 24.2 for fn{x) = 

24.4 Repeat Exercise 24.2 for fn{x) = jf^. 

24.5 Repeat Exercise 24.2 for fn{x) = 

24.6 Let fn{x) = {x - for x G [0, 1]. 

(a) Does the sequence (fn) converge pointwise on the set [0, 1]? If 
so, give the limit function. 

(b) Does (fn) converge uniformly on [0, 1]? Prove your assertion. 

24.7 Repeat Exercise 24.6 for fn{x) = x — x^. 

24.8 Repeat Exercise 24.6 for fn{x) = J^^^q x^. 

24.9 Consider fn{x) = nx^(l - x) for x G [0, 1]. 

(a) Find f{x) = \imfn{x). 

(b) Does fn^f uniformly on [0, 1]? Justify. 

(c) Does Jq fn{x) dx converge to f{x) dx7 Justify. 

24.10 (a) Prove that if fn ^ f uniformly on a set and \i Qn ^ g 
uniformly on then fn ^ dn ^ f ^ 9 uniformly on 5'. 
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(b) Do you believe the analogue of (a) holds for products? If so, see 
the next exercise. 

24.11 Let fn{x) = X and gn{x) = ^ for all x G M. Let f{x) = x and 
g{x) = 0 for X G M. 

(a) Observe fn ^ f uniformly on R [obvious!] and Qn ^ 9 
uniformly on M [almost obvious] . 

(b) Observe the sequence {fngn) does not converge uniformly to fg 
on R. Compare Exercise 24.2. 

24.12 Prove the assertion in Remark 24.4. 

24.13 Prove that if (/n) is a sequence of uniformly continuous functions 
on an interval (a, 6), and if ^ / uniformly on (a, 6), then / is 
also uniformly continuous on (a, 6). Hint: Try an | argument as in 
the proof of Theorem 24.3. 

24.14 Let fn{x) = and f{x) = 0 for x G M. 

(a) Show fn^f pointwise on M. 

(b) Does fn^f uniformly on [0, 1]? Justify. 

(c) Does fn^f uniformly on [1, oc)? Justify. 

24.15 Let fn{x) = ioi x e [0,oc). 

(a) Find f{x) = \imfn{x). 

(b) Does fn^f uniformly on [0, 1]? Justify. 

(c) Does fn^f uniformly on [1, oc)? Justify. 

24.16 Repeat Exercise 24.15 for fn{x) = 

24.17 Let {fn) be a sequence of continuous functions on [a, 6] that con- 
verges uniformly to / on [a, 6]. Show that if (xn) is a sequence in 
[a, b] and if Xn x, then lim^^cx) fn{xn) = f{x). 



§25 More on Uniform Convergence 

Our next theorem shows one can interchange integrals and uni- 
form limits. The adjective "uniform" here is important; compare 
Exercise 23.9. 
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25.1 Discussion. 

To prove Theorem 25.2 below we merely use some basic facts about 
integration which should be familiar [or believable] even if your 
calculus is rusty. Specifically, we use: 

(a) // g and h are integrable on [a, 6] and if g{x) < h{x) for all 
X G [a, 6], then g{x)dx < h{x)dx. See Theorem 33.4(i). 

We also use the following corollary: 

(b) If g is integrable on [a, 6], then 



g{x) dx 



< 



\g{x) \ dx. 



Continuous functions on closed intervals are integrable, as noted 
in Discussion 19.3 and proved in Theorem 33.2. □ 



25.2 Theorem. 

Let (fn) be a sequence of continuous functions on [a^b], and suppose 
fn^f uniformly on [a, 6]. Then 



lim 



fn{x) dx 



f{x) dx. 



(1) 



Proof 

By Theorem 24.3 / is continuous, so the functions fn — f are all 
integrable on [a, b]. Let e > 0. Since fn ^ f uniformly on [a, 6], there 
exists a number such that \fn{x) — f{x)\ < for all x G [a, 6] 
and all n > A^. Consequently n > N implies 



pb nb nb 

/ fn{x)dx- / f{x)dx = / [fn{x) - f{x)]dx 

J a J a J a 



< 



J a 



f{x)\dx< 



Ja b-a 



dx 



The first < follows from Discussion 25.1(b) applied to g = fn — f and 
the second < follows from Discussion 25.1(a) applied to ^ = |/^ — / | 
and h = ^3^; h happens to be a constant function, but this does no 
harm. 

The last paragraph shows that given e > 0, there exists 
such that \ fn{x) dx — f{x)dx\ < e for n > N. Therefore (1) 
holds. a a ^ 
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Recall one of the advantages of the notion of Cauchy sequence: 
A sequence (sn) of real numbers can be shown to converge without 
knowing its limit by simply verifying that it is a Cauchy sequence. 
Clearly a similar result for sequences of functions would be valuable, 
since it is likely that we will not know the limit function in advance. 
What we need is the idea of "uniformly Cauchy." 

25.3 Definition. 

A sequence (/^) of functions defined on a set 5 C R is uniformly 
Cauchy on S if 

for each e > 0 there exists a number N such that 
\fn{x) — fm{x)\ < e for all X e S and all m,n > N. 

Compare this definition with that of a Cauchy sequence of real 
numbers [Definition 10.8] and that of uniform convergence [Defi- 
nition 24.2]. It is an easy exercise to show uniformly convergent 
sequences of functions are uniformly Cauchy; see Exercise 25.4. The 
interesting and useful result is the converse, just as in the case of 
sequences of real numbers. 

25.4 Theorem. 

Let (fn) be a sequence of functions defined and uniformly Cauchy on 
a set 5 C R. Then there exists a function f on S such that fn^f 
uniformly on S. 

Proof 

First we have to "find" /. We begin by showing 

for each xq ^ S the sequence {fn{xo)) is a Cauchy 
sequence of real numbers. 

For each e > 0, there exists N such that 

\fn{x) — fm{x)\ < e for X ^ S and m^n > N. 

In particular, we have 

\fn{xo) - fm{xo)\ < 6 for m, n > A^. 

This shows {fn{xo)) is a Cauchy sequence, so (1) holds. 
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Now for each x in S, assertion (1) implies lim^^oo /n(^) exists; 
this is proved in Theorem 10.11 which in the end depends on the 
Completeness Axiom 4.4. Hence we define f{x) = lim^^oo 
This defines a function f on S such that fn^f pointwise on S. 

Now that we have "found" /, we need to prove fn^f uniformly 
on S. Let e > 0. There is a number N such that 

\fn{x) — fm{x)\ < ^ for all X ^ S and all m^n > N. (2) 

Consider m > N and x e S. Assertion (2) tells us that fn{x) lies in 
the open interval {fm{x) — fm{x) + |) for all n > N. Therefore, 
as noted in Exercise 8.9, the limit f{x) — lim^^oo fn{x) lies in the 
closed interval [fm{x) — |, /^(x) + |]. In other words, 

\f{x) — fm{x)\ < ^ for all X ^ S and m > N. 
Then of course 

\f{x) — fm{x)\ < e for all x ^ S and m > N. 
This shows fm^f uniformly on 5, as desired. ■ 

Theorem 25.4 is especially useful for "series of functions." Let us 
recall what X^^i cik signifies when the a^s are real numbers. This 
signifies lim^^oo ^k=i provided this limit exists [as a real number, 
+00 or —00]. Otherwise the symbol X^^i cik has no meaning. Thus 
the infinite series is the limit of the sequence of partial sums Ylk=i ^k- 
Similar remarks apply to series of functions. A series of functions is 
an expression ^^^^Qk or X]^o^^(^) which makes sense provided 
the sequence of partial sums Ylk=o 9k converges, or diverges to +00 
or — oc pointwise. If the sequence of partial sums converges uniformly 
on a set S to X^^q 9ki then we say the series is uniformly convergent 
on S. 

Example 1 

Any power series is a series of functions, since X^^q ^k^^ has the 
form YlV={)9k where gk{x) = a^x^ for all x. □ 
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FIGURE 25.1 

Example 2 

J2T=o T+^fc ^ series of functions, but is not a power series, at least 
not in its present form. This is a series Yll^={)9k where ^o(^) = \ foi" 

2 

all X, gi{x) = ^5 92{x) = for all x, etc. □ 

Example 3 

Let g be the function drawn in Fig. 25.1, and let gn{x) — g{A^x) for 
all X G R. Then Yl^={){\)^ 9n{x) is a series of functions. The limit 
function / is continuous on R, but has the amazing property that it is 
not different iable at any point! The proof of the nondifferentiability 
of / is somewhat delicate; see [62, 7.18]. A similar example is given 
in Example 38.1 on page 348. □ 

Theorems for sequences of functions translate easily into theo- 
rems for series of functions. Here is an example. 

25.5 Theorem. 

Consider a series YlV=Q9k of functions on a set 5 C R. Suppose 
each gk is continuous on S and the series converges uniformly on S. 
Then the series Y^^=o9k represents a continuous function on S. 

Proof 

Each partial sum = Yl^=i 9k is continuous and the sequence (/^) 
converges uniformly on S. Hence the limit function is continuous by 
Theorem 24.3. ■ 
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Recall the Cauchy criterion for series ^ ak given in Defini- 
tion 14.3: 

for each e > 0 there exists a number N such that 
n > m > N implies | J2^=m < ^^ 

The analogue for series of functions is also useful. The sequence of 
partial sums of a series J2k^=o9k of functions is uniformly Cauchy 
on a set S if and only if the series satisfies the Cauchy criterion 
[uniformly on S]: 

for each e > 0 there exists a number N such that 
n > m > N implies | X^^^^ 9k{x)\ < e for all x ^ S. 

25.6 Theorem. 

// a series J2T=o9k of functions satisfies the Cauchy criterion 
uniformly on a set then the series converges uniformly on S. 

Proof 

Let fn = Ylk=o9k- The sequence (/^) of partial sums is uni- 
formly Cauchy on 5, so (/^) converges uniformly on S by 
Theorem 25.4. ■ 

Here is a useful corollary. 

25.7 Weierstrass M-test. 

Let {Mk) be a sequence of nonnegative real numbers where ^k < 
oo. // ^ ^k for all X in a set then converges 

uniformly on S. 



To verify the Cauchy criterion on S, let e > 0. Since the series J2 ^k 
converges, it satisfies the Cauchy criterion in Definition 14.3. So there 
exists a number N such that 



Proof 



n 



n > m > N implies 




k=m 



Hence if n > m > and x is in 5, then 



n n n 



k=m k=m k=m 
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Thus the series Yl 9k satisfies the Cauchy criterion uniformly on S, 
and Theorem 25.6 shows it converges uniformly on S. ■ 

Example 4 

Show 2~^x^ represents a continuous function / on (—2, 2), but 

the convergence is not uniform. □ 

Solution 

This is a power series with radius of convergence 2. Clearly the series 
does not converge at x = 2 or at x = —2, so its interval of convergence 
is (-2,2). 

Consider 0 < a < 2 and note E^=i 2"''a^ = J2n=ii^T con- 
verges. Since |2~^x^| < 2~^a^ = (|)^ for x G [—a, a], the Weierstrass 
M-test 25.7 shows the series X^^i 2~^x^ converges uniformly to a 
function on [—a, a]. By Theorem 25.5 the limit function / is contin- 
uous at each point of the set [—a, a]. Since a can be any number less 
than 2, we conclude / represents a continuous function on (—2, 2). 

Since we have sup{|2~^x^| : x G (—2,2)} = 1 for each n, the 
convergence of the series cannot be uniform on (—2,2) in view of the 
next example. □ 



Example 5 

Show that if the series Yl 9n converges uniformly on a set 5, then 



lim sup{|^^(x) 



: X G 5} = 0. 



Solution 

Let e > 0. Since the series ^ Qn satisfies the Cauchy criterion, there 
exists such that 



n > m > N implies 



k=m 



< e for all x e S. 



In particular, 

n > N implies |^n(^)| < ^ for all x ^ S. 

Therefore 

n > N implies sup{|^^(x)| : x ^ S} < e. 
This establishes (1). 



□ 
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Exercises 

25.1 Derive Discussions 25.1(b) from 25.1(a). Hint: Apply (a) twice, once 
to g and \g\ and once to —\g\ and g. 

25.2 Let fn{x) = Show (/n) is uniformly convergent on [—1,1] and 
specify the limit function. 

25.3 Let fn(x) = ^^"^^.^ for ah real numbers x. 

J ) 2n+sin^ a: 

(a) Show (/n) converges uniformly on R. Hint'. First decide what 
the limit function is; then show (/n) converges uniformly to it. 

(b) Calculate lim^^oo /J' /n(^) Hint'. Don't integrate jn- 

25 A Let (/n) be a sequence of functions on a set 5' C R, and suppose 
fn^f uniformly on 5*. Prove (/n) is uniformly Cauchy on 5*. Hint: 
Use the proof of Lemma 10.9 on page 63 as a model, but be careful. 

25.5 Let (/n) be a sequence of bounded functions on a set 5', and suppose 
fn^f uniformly on S. Prove / is a bounded function on S. 

25.6 (a) Show that if XI l^fel ^ then ^akX^ converges uniformly on 

[—1,1] to a continuous function. 

(b) Does Xl^i represent a continuous function on [—1,1]? 

25.7 Show Xl^i -^cosnx converges uniformly on R to a continuous 
function. 

25.8 Show T -^-^ has radius of convergence 2 and the series 
converges uniformly to a continuous function on [—2,2]. 

25.9 (a) Let 0 < a < 1. Show the series X^^q converges uniformly 

on [-a, a] to j^. 

(b) Does the series X^^q converge uniformly on (—1,1) to ^z^? 
Explain. 

25.10 (a) Show converges for x G [0, 1). 

(b) Show that the series converges uniformly on [0, a] for each a, 
0 < a < 1. 

(c) Does the series converge uniformly on [0, 1)? Explain. 

25.11 (a) Sketch the functions go^ ^i, g2 and gs in Example 3. 
(b) Prove the function / in Example 3 is continuous. 
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25.12 Suppose Xlfc^i ^fe ^ series of continuous functions gk on [a, 6] that 
converges uniformly to g on [a, 6]. Prove 



25.13 Suppose X^^i 9k and Xlfeli ^fc converge uniformly on a set 5'. Show 
YlV^iidk + hk) converges uniformly on S. 

25.14 Prove that if ^gu converges uniformly on a set S and if /i is a 
bounded function on 5', then ^ hgk converges uniformly on S. 

25.15 Let (/n) be a sequence of continuous functions on [a, 6]. 

(a) Suppose that, for each x in [a, 6], {fn{x)) is a decreasing se- 
quence of real numbers. Prove that if ^ 0 pointwise on 
[a, 6], then /n ^ 0 uniformly on [a, b]. Hint: If not, there exists 
e > 0 and a sequence {xn) in [a, b] such that fn{xn) ^ ^ foi" all 
n. Obtain a contradiction. 

(b) Suppose that, for each x in [a, 6], {fn{x)) is an increasing se- 
quence of real numbers. Prove that if ^ / pointwise on [a, b] 
and if / is continuous on [a, 6], then fn^f uniformly on [a, b]. 
This is Dini's theorem. 

§26 Differentiation and Integration of Power 
Series 

The following result was mentioned in §23 after Example 8. 
26.1 Theorem. 

Let J2^=o ^nX^ be a power series with radius of convergence R > 0 
[possibly R = +00]. If Q < Ri < R, then the power series converges 
uniformly on [— to a continuous function. 



Consider 0 < i?i < i?. A glance at Theorem 23.1 shows the se- 
ries J2^nX^ and ^|a^|x^ have the same radius of convergence, 
since /3 and R are defined in terms of |a^|. Since < i?, we 

have ^\an\Ri < 00. Clearly we have |a^x^| < \an\Ri for all x in 




Proof 
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[— SO the series ^ a^x'^ converges uniformly on [— Ri] by 
the Weierstrass M-test 25.7. The hmit function is continuous at each 
point of [— by Theorem 25.5. ■ 



26.2 Corollary. 

The power series cinX^ converges to a continuous function on the 
open interval {—R^R). 

Proof 

If xq G (— i?, i?), then xq G (— Ri) for some Ri < R. The theorem 
shows the hmit of the series is continuous at xq. ■ 



We emphasize that a power series need not converge uniformly 
on its interval of convergence though it might; see Example 4 of §25 
and Exercise 25.8. 

We are going to differentiate and integrate power series term- 
by-term, so clearly it would be useful to know where the new series 
converge. The next lemma tells us. 



26.3 Lemma. 

// the power series X^^q ^nX^ has radius of convergence R, then the 
power series 

oo oo 



EnariX^ ^ and x^' 
^ n + 1 



n=l n=0 

also have radius of convergence R. 
Proof 

First observe the series ^na^x^"-^ and "^nanX^ have the same ra- 
dius of convergence: since the second series is x times the first series, 
they converge for exactly the same values of x. Likewise ^ ^^^^^"^ 
and ^ T^fi^^ have the same radius of convergence. 

Next recall i? = ^ where /3 = limsup la^l-*^/^. For the se- 
ries ^nanX^, we consider limsup(n|a^|)-'^/^ = limsupn-^/^|a^|-'^/^. 
By Theorem 9.7(c) on page 48, we have limn^^^ = 1, so 
limsup(n|a^|)-'^/^ = /3 by Theorem 12.1 on page 78. Hence the series 
J2 Tiajix'^ has radius of convergence R. 
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For the series ^ -^^x^^ we consider limsup(|^)-'^/^. It is easy 
to show hm(n + 1)^/^ = 1; therefore hm(^^)-'^/^ = 1. Hence by 

Theorem 12.1 we have hmsup(]^)-^/^ = /3, so the series Yl 7^^^ 
has radius of convergence R. ■ 



26.4 Theorem. 

Suppose f{x) — X^^o ^nX^ has radius of convergence R > 0. Then 
r f{t)dt^Y ^^x""^^ for \x\<R. (1) 

Proof 

We fix X and assume x < 0; the case x > 0 is similar [Exercise 26.1]. 
On the interval [x,0], the sequence of partial sums Y^^=o^kt^ 
converges uniformly to f{t) by Theorem 26.1. Consequently, by 
Theorem 25.2 we have 

/ f(t)dt= lim / iy^akt^] dt = lim Va^ / dt 



\k=0 / k=0 
oo 



= Ya, " ^ ^ (2) 



n^oo ■ 

k=0 



k + 1 



The second equality is valid because we can interchange integrals 
and finite sums; this is a basic property of integrals [Theorem 33.3]. 
Since f{t) dt ^ - f{t) dt, Eq. (2) implies Eq. (1). ■ 

The theorem just proved shows that a power series can be inte- 
grated term- by-term inside its interval of convergence. Term- by-term 
differentiation is also legal. 

26.5 Theorem. 

Let f{x) = X]^o ^nX^ have radius of convergence R > 0. Then f is 
differentiahle on {—R,R) and 

oo 

/'(x) = ^na„a;"-^ for \x\ < R. (1) 

n=l 
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The proof of Theorem 26.4 was a straightforward apphcation of 
Theorem 25.2, but the direct analogue of Theorem 25.2 for deriva- 
tives is not true [see Exercise 23.8 and Example 4 of §24]. So we give 
a devious indirect proof of the theorem. 

Proof 

We begin with the series g{x) = X^^i nanX^~^ and observe this 
series converges for \x\ < R hy Lemma 26.3. Theorem 26.4 shows 
that we can integrate g term-by-term: 



where A; is a constant; in fact, k — qq — J_^^ g{t) dt. Since g is contin- 
uous, one of the versions of the Fundamental Theorem of Calculus 
[Theorem 34.3] shows / is differentiable and f\x) — g{x). Thus 




for \x\ < R. 



Thus iiO <Ri<R, then 




g{t)dt + k for \x\ < Ri 



oo 




for \x\ < R. 



n=l 



Example 1 

Recall 




1 — X 



for Ixl < 1. 



(1) 



n=0 



Differentiating term-by-term, we obtain 




for 



x\ < 1. 



Integrating (1) term- by-term, we get 




dt 



logg(l -x) 
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or 



oo ^ 

logg(l -x) = -^-x'^ for |x| < 1. (2) 



n=l 



Replacing x by — x, we find 

2 S 4 

X X X 

loge(l + = a: - y + y - — + ■■■ for < 1. (3) 

It turns out that this equahty is also vahd for a; = 1 [see Example 2] , 
so we have the interesting identity 

^ . 11111 
loge2 = l-- + 3-- + --- + ---. (4) 

In Eq. (2) set x = Then 

y2 ~ \~ " ) = -loge ( 1 - — -] = -loge ( — ) = loge^. 

n \ m J \ m J \m J 

Hence we have 

oo^ oo^/ -\\n 

El v-^ 1/m — 1\ ^ . 
— > > — = log m tor all m. 

^ n ^-f n \ m I 

n=l n=l ^ ^ 

Here is yet another proof that X^^i n ^ ^ 

To establish (4) we need a relatively difficult theorem about 
convergence of a power series at the endpoints of its interval of 
convergence. 

26.6 Abel's Theorem. 

Let f{x) = J2^=o ^nX^ be a power series with finite positive radius of 
convergence R. If the series converges atx — R, then f is continuous 
at X = R. If the series converges at x = —R, then f is continuous 
at X = —R. 

Example 2 

As promised, we return to (3) in Example 1: 

x^ x^ 

logg(l + x) = X - — + — ^ for |x| < 1. 
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For X — 1 the series converges by the Alternating Series Theo- 
rem 15.3. Thus the series represents a function / on ( — 1, 1] that is 
continuous at x = 1 by Abel's theorem. The function logg(l + x) 
is also continuous at x = 1, so the functions agree at x = 1. 
[In detail, if (x^) is a sequence in (—1,1) converging to 1, then 
/(I) = lim^^oo/(^n) lim^^oologe(l + ^n) logg 2.] Therefore 
we have 

^ . 11111 
Another proof of this identity is given in Example 2 of §31. □ 
Example 3 

Recall nx'^ = for IxI < 1. Note that at x = — 1 the function 
is continuous and takes the value ^. However, the series does 

l—x 2 ' 

not converge for x = —1, so Abel's theorem does not apply. □ 



Proof of Abel's Theorem 

The heart of the proof is in Case 1. 

Case 1. Suppose f{x) = X^^o ^^^^ radius of convergence 1 
and the series converges at x = 1. We will prove / is continuous 
on [0, 1]. By subtracting a constant from /, we may assume /(I) = 

Y.n=0^n = 0. Let fn{x) = ELo ^^^^ 5^ = J2k=0 = 

for n = 0, 1, 2, . . .. Since fn{x) f{x) pointwise on [0, 1] and each 
fn is continuous. Theorem 24.3 on page 196 shows it suffices to show 
fn ^ f uniformly on [0,1]. Theorem 25.4 on page 202 shows it 
suffices to show the convergence is uniformly Cauchy. 
For m < n, we have 

n n 
fn{x) - fm{x) = ^ akX^ = ^ i^k- Sk-l)x^ 
k=m-\-l k=m-\-l 



k=m-\-l k=m-\-l 
n n—1 
= ^ SkX^ - x"^ SkX^, 
k=m-\-l k=m 



k-1 
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and therefore 

n-l 

fn{x)-fm{x) = SnX^-SmX^^^ + {l-x) '^X^ (1) 

k=m-\-l 



Since lim 5^ = Y1V=Q — /(I) — 0, given e > 0, there is an integer N 
so that < I for all n > N. Then for n > m > and x in [0, 1), 



we have 



n-l 

(1-x) SkX^ 
k=m-\-l 



n-l 

<'-{l-x) 

k=m-\-l 

The first term in inequality (2) is also less than | for x = 1. 
Therefore, for n > m > and x in [0, 1], (1) and (2) show 

Thus the sequence (/^) is uniformly Cauchy on [0, 1], and its limit 
/ is continuous. 

Case 2. Suppose f{x) = X^^o ^nX^ has radius of convergence i?, 
0 < i? < 00, and the series converges at x = i?. Let g{x) = f{Rx) 
and note that 

00 

gl^x) = Y^anR^x"^ for \x\ < 1. 

This series has radius of convergence 1, and it converges at x = 1. 
By Case 1, ^ is continuous at x = 1. Since f{x) = 9{%)i it follows 
that / is continuous at x = i?. 

Case 3. Suppose f{x) = X^^o ^nX^ has radius of convergence i?, 
0 < i? < 00, and the series converges at x = —R. Let h{x) = /(— x) 
and note that 

00 

h{x) = ^(-l)'^a^x'' for |x| < R. 

The series for h converges at x = i?, so /i is continuous at x = i? by 
Case 2. It follows that /(x) = h{—x) is continuous at x = —R. h 
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The point of view in our extremely brief introduction to power 
series has been: For a given power series ^a^x^, what can one say 
about the function f{x) = ^a^x^? This point of view was mis- 
leading. Often, in real life, one begins with a function / and seeks a 
power series that represents the function for some or all values of x. 
This is because power series, being limits of polynomials, are in some 
sense basic objects. 

If we have f{x) = X^^o ^nX^ for |x| < i?, then we can differenti- 
ate / term- by-term forever. At each step, we may calculate the kih 
derivative of / at 0, written f^^\0). It is easy to show/(^)(0) = k\ak 
for A: > 0. This tells us that if f can be represented by a power series, 

then that power series must be X^^o kf^ ' This is the Taylor se- 
ries for / about 0. Frequently, but not always, the Taylor series will 
agree with / on the interval of convergence. This turns out to be 
true for many familiar functions. Thus the following relations can be 
proved: 

oo ^ oo (^\k ^ i — V]^ 

e^ = y^— x^, cosx = x^^, sinx = y^-7; — -TT-.x^^^^ 

^ k\ ' ^ (2k)\ ' ^ (2k + l)\ 

k=0 k=0 ^ ^ k=0 ^ ^ 

for all X in M. A detailed study of Taylor series is given in §31. 



Exercises 

26.1 Prove Theorem 26.4 for x > 0. 

26.2 (a) Observe X^^i nx^ = ^^^^y for \x\ < 1; see Example 1. 

(b) Evaluate X^^i i^- Compare with Exercise 14.13(d). 

(c) Evaluate ^Zi 1^ and E~ i 

26.3 (a) Use Exercise 26.2 to derive an explicit formula for Xl^i 

(b) Evaluate EZi W and Y.n=i t^- 

26.4 (a) Observe = Xl^o x G M, since we have = 

E~ 1 ^a;" for X G M. 

(b) Express F{x) = f^ e~^^ dt as a power series. 
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26.5 Let f{x) = ^^^^ for x e R. Show = /. Do not use the fact 
that f{x) = e^; this is true but has not been estabhshed at this point 
in the text. 

26.6 Let s{x) = x-^^^ and c{x) = 1-^^^ for x G M. 

(a) Prove = c and = —5. 

(b) Prove {s^ c^)' = 0. 

(c) Prove 5^ + = 1. 

Actuahy s{x) = sinx and c{x) = cosx, but you do not need these 
facts. 

26.7 Let f{x) = \x\ for x G M. Is there a power series ^anX^ such that 
f{x) = X^^o ^nX^ for all x7 Discuss. 

26.8 (a) Show EZoi^T^^"" = for x G (-1,1). Hint: E^^o = 

Let y — —x'^. 

l-y ^ 

(b) Show arctanx = ^^=0 2^^^""^^ fo^ ^ ^ (-1' 

(c) Show the equality in (b) also holds for x = 1. Use this to find a 
nice formula for tt. 

(d) What happens at x = — 1? 



§27 * Weierstrass's Approximation Theorem 

Suppose a power series has radius of convergence greater than 1, and 
let / denote the function given by the power series. Theorem 26.1 
tells us that the partial sums of the power series get uniformly close 
to / on [—1,1]. In other words, / can be approximated uniformly 
on [—1,1] by polynomials. Weierstrass's approximation theorem is 
a generalization of this last observation, for it tells us that any 
continuous function on [—1, 1] can be uniformly approximated by 
polynomials on [—1,1]. This result is quite different because such a 
function need not be given by a power series; see Exercise 26.7. The 
approximation theorem is valid for any closed interval [a, b] and can 
be deduced easily from the case [0, 1]; see Exercise 27.1. 

We give the beautiful proof due to S. N. Bernstein. Bernstein 
was motivated by probabilistic considerations, but we will not use 
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any probability here. One of the attractive features of Bernstein's 
proof is that the approximating polynomials will be given explicitly. 
There are more abstract proofs in which this is not the case. On the 
other hand, the abstract proofs lead to far-reaching and important 
generalizations. See the treatment in [31] or [62]. 

We need some preliminary facts about polynomials involving 
binomial coefficients. 



27.1 Lemma. 

For every x G M and n>Q, we have 

f;(^).^(i-.r- = i. 

Proof 

This is just the binomial theorem [Exercise 1.12] applied to a = x 
and 6 = 1 — X, since in this case (a + 6)^ = 1^ = 1. ■ 



27.2 Lemma. 

For X G R and n > 0, we have 

n 



k=0 

Proof 

/n-l 



^(nx - kf Cf)x\l - xy-^ = nx{l - ^) < ^. (1) 

h—r\ \ / 



Since = n{^_-^ for A; > 1, we have 



n-1 

n-1- 3 



X) 

nx. (2) 

n-2\ 



Since k{k - 1)(^) = n{n - l){lZ^^ for /c > 2, we have 

k{k - 1) (^) x\l - x^-^ = n{n - l)x^ ~ ^) " ^)""'"' 

= n{n — l)x'^. (3) 
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Adding the results in (2) and (3), we find 

^ A;^ ( ^ j - x)"""^ = n{n - l)x^ + nx = n^x^ + nx{l - x). (4) 
k=o 

Since {nx — kY = n^x^ — 2nx'k^k^ ^ we use Lemma 27.1, (2) and (4) 
to obtain 

^(nx - kf ("f] x^{l - xY'^ = n^x^ - 2nx(nx) + [n'x' + nx(\ - x)\ 

= nx{l — x). 



This estabhshes the equahty in (1). The inequahty in (1) simply 
reflects the inequality x{l — x) < |, which is equivalent to 4x^ — 4x + 
1 > 0 or (2x - 1)2 > 0. ■ 

27.3 Definition. 

Let / be a function defined on [0, 1]. The polynomials Bnf defined 

by 

k=o ^ ^ ^ ^ 
are called Bernstein polynomials for the function /. 

Here is Bernstein's version of the Weierstrass approximation 
theorem. 

27.4 Theorem. 

For every continuous function f on [0, 1]; we have 
Bnf f uniformly on [0, 1]. 

Proof 

We assume / is not identically zero, and we let 

M = sup{|/(x)| :xe [0,1]}. 

Consider e > 0. Since / is uniformly continuous by Theorem 19.2, 
there exists 6 > 0 such that 

x,yG[0, 1] and \x - y\ < 6 imply \f{x)-f{y)\<^. (1) 
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Let N = This choice of N is unmotivated at this point, but we 
make it here to emphasize that it does not depend on the choice of x. 
We will show 

\Bnf{x)-f{x)\<e for all x G [0, 1] and all n > A^, (2) 

completing the proof of the theorem. 

To prove (2), consider a fixed x G [0, 1] and n > A^. In view of 
Lemma 27.1, we have 



so 



/(x) = X^/(x)(")x'^(l 

fc=0 ^ ^ 

\Br.f{x)-f{x)\<J2 /(^)-/(^) 

k=0 



X) 



n 



x^il-x^-^. (3) 



To estimate this sum, we divide the set {0, 1, 2, . . . , n} into two sets: 



k 



n 



< 6 while k e B if 



k 



n 



> 6. 



For k e A we have |/(-) - f{x)\ < § by (1), so 



E 

keA 



n 



keA ^ ^ 



(4) 



using Lemma 27. L For k ^ we have l^^f^l > 5 oi {k — nx)'^ > 
v?8^ , so 



E 

keB 



^^'=(1 - xf-^ - J ^^^^^ ~ 



2M V-., 



n 



keB 



n 



nxr I ^ l^:^ (1 - x) 



n—k 



By Lemma 27.2, this is bounded by 
2M n M 



< 



M 



4 2n(52 2N6'^ 2* 



220 ^' Sequences and Series of Functions 



This observation, (4) and (3) show 

\Bnf{x)-f{x)\<e. 
That is, (2) holds. ■ 

27.5 Weierstrass's Approximation Theorem. 

Every continuous function on a closed interval [a, b] can be uniformly 
approximated by polynomials on [a, 6]. 

In other words, given a continuous function / on [a, 6], there exists 
a sequence (pn) of polynomials such that Pn ^ f uniformly on [a, b]. 

27.6 Corollary. 

Given a continuous function f on [a^b], there exists a sequence (pn) 
of polynomials such that Pn f uniformly on [a,b]^ and for each n, 
Pn{o) = f{o) andpn(b) ^ f(b). 

Proof 

See Exercise 27.4. ■ 



Exercises 

27.1 Prove Theorem 27.5 from Theorem 27.4. Hint: Let (j){x) = {b-a)x + a 
so that (/) maps [0, 1] onto [a, b].lf f is continuous on [a, 6], then f ocj) 
is continuous on [0, 1]. 

27.2 Show that if / is continuous on R, then there exists a sequence {pn) 
of polynomials such that Pn f uniformly on each bounded subset 
of M. Hint: Arrange for \f{x) — Pn{x)\ < ^ for \x\ < n. 

27.3 Show there does not exist a sequence of polynomials converging 
uniformly on R to / if 

(a) f{x) = sinx, (b) f{x) = e^. 

27.4 Prove Corollary 27.6. Hint: Select a sequence {qn) of polynomials such 
that qn ^ f uniformly on [a, 6]. For each n, let Sn be the function 
on M whose graph is the straight line passing through the points 
(a, /(a) - qn{a)) and (6, f{b) - qn{b)). Set Pn = qn ^ Sn- 



27.5 Find the sequence (Bnf) of Bernstein polynomials in case 
(a) f{x) = X, (b) f{x) = x^. 
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27.6 The Bernstein polynomials were defined for any function / on [0, 1]. 
Show that if Bnf f uniformly on [0,1], then / is continuous 
on [0,1]. 

27.7 Let / be a bounded function on [0, 1], say \f{x)\ < M for all x G [0, 1]. 
Show that all the Bernstein polynomials Bnf are bounded by M. 
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CHAPTER 



Differentiation 



In this chapter we give a theoretical treatment of differentiation and 
related concepts, most or all of which will be familiar from the stan- 
dard calculus course. Three of the most useful results are the Mean 
Value Theorem which is treated in §29, L'Hospital's Rule which is 
treated in §30, and Taylor's Theorem which is given in §31. 



§28 Basic Properties of the Derivative 

The reader may wish to review the theory of limits treated in §20. 
28.1 Definition. 

Let / be a real- valued function defined on an open interval containing 
a point a. We say / is differentiable at a, or / has a derivative at a, 
if the limit 



x^a X — a 
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exists and is finite. We will write f^{a) for the derivative of / at a: 

f\a) = lim (1) 

whenever this limit exists and is finite. 

Generally speaking, we will be interested in as a function in 
its own right. The domain of f is the set of points at which / is 
differentiable; thus dom(/^) C dom(/). 

Example 1 

The derivative of the function g{x) = x'^ dX x — 2 was calculated in 
Example 2 of §20: 

-4 

g\2) lim lim(x + 2) = 4. 

We can calculate g\a) just as easily: 

— o?' 

g\a) — lim = lim(x + a) = 2a. 

x^a X — a x^a 

This computation is even valid for a = 0. We may write g\x) = 2x 
since the name of the variable a or x is immaterial. Thus the deriva- 
tive of the function given by g(x) = x^ is the function given by 
g^{x) = 2x, as every calculus student knows. □ 

Example 2 

The derivative of h{x) = ^/x at x = 1 was calculated in Example 3 
of §20: h\l) = ^. In fact, h{x) = x^/^ for x > 0 and h\x) = ^x'^/^ 
for X > 0; see Exercise 28.3. □ 

Example 3 

Let n be a positive integer, and let /(x) = x^ for all x G R. We show 
f\x) = nx'^~^ for all x G M. Fix a in R and observe 

j[x) — j[a) = x —a = [x — a)[x -\-ax -\-a x +---+a x+a ), 



so 



fix) f{a) ^ ^ ^^„_2 ^ ^2^n-3 ^ . . . ^ ^ 



X — a 
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for X ^ a. It follows that 
fix) - f{a) 



f{a) = lim 

x^a X — a 

= a"-^ + aa"-2 + a^a"-^ + • • • + a^'^a + a""^ = na"-^; 

we are using Theoreni 20.4 and the fact that lirQ^^^^ for k 

in N. □ 

We first prove differentiability at a point implies continuity at 
the point. This may seem obvious from all the pictures of familiar 
differentiable functions. However, Exercise 28.8 contains an example 
of a function that is differentiable at 0 and of course continuous at 
0 [by the next theorem], but is discontinuous at all other points. 

28.2 Theorem. 

/// is differentiable at a point a, then f is continuous at a. 
Proof 

We are given /'(a) = lim^^^a "^^^E^^ 5 and we need to prove 
limx^a f{x) = f{a). We have 

f[x) = (x - a) + /(a) 

x — a 

for X G dom(/), x ^ a. Since Imix^aix — a) = 0 and lim^^^a 
exists and is finite. Theorem 20.4(ii) shows Yvnix^aix — a)- 
— 0- Therefore lim^^^a f{x) — f{a)^ as desired. ■ 

We next prove some results about sums, products, etc. of deriva- 
tives. Let us first recall why the product rule is not {fg)' = f'g' 
[as many naive calculus students wish!] even though the product of 
limits does behave as expected: 

lim(/i/2)(x) = lim/i(x) • lim /2(x) 

x^a \_x^a J \_x^a 

provided the limits on the right side exist and are finite; see Theo- 
rem 20.4(ii). The difficulty is that the limit for the derivative of the 
product is not the product of the limits of the derivatives, i.e., 

f{x)g{x) - f{a)g{a) ^ f{x) - f{a) ^ g{x) - g{a) 
X a X a X a 
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The correct product rule is obtained by shrewdly writing the left 
hand side in terms of - 
Theorem 28.3(iii) below. 



hand side in terms of ^^^^ J^^^ and as in the proof of 



28.3 Theorem. 

Let f and g be functions that are differentiable at the point a. Each of 
the functions of [c a constant], f+g, fg and f /g is also differentiable 
at a, except f / g if g{a) = 0 since f j g is not defined at a in this case. 
The formulas are 

(i) {cf)'{a) = c-na)- 

(ii) {f + 9y{a) = na)+g'{a); 

(iii) [product rule] {fg)'{a) = f{a)g'{a) + f'{a)g{a); 

(iv) [quotient rule] {f/g)'{a) = [g{a)f{a) - f{a)g'{a)]/g^{a) if 
g{a) + 0. 

Proof 

(i) By definition of cf we have {cf){x) = c • f{x) for all x E 
dom(/); hence 

(c/)'(a) = lim ^ ^ 

x^a X — a x^a X — a 

(ii) This follows from the identity 

{f + g){x)-{f + g){a) ^ f{x)-f{a) ^ g{x) - g{a) 



X CL X CL X CL 



upon taking the limit as x ^ a and applying Theorem 20.4(i). 
(iii) Observe 

{f9){x) - {fg){a) _ j^^^ 9{x) -gja) ^ g^a)^^^^ ~ ^^^^ 



X — a X — a X — a 

for X G dom(/^), x ^ a. We take the limit as x ^ a and note 
that \i-mx^af{x) = /(a) by Theorem 28.2. We obtain [again 
using Theorem 20.4] 

Ugna) = f{a)g'{a)+g{a)f{a). 

(iv) Since g{a) ^ 0 and g is continuous at a, there exists an open 
interval / containing a such that g{x) ^ 0 for x E I. For x E I 
we can write 
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g{x) g{a) g{x)g{a) 
g{a)f{x) - g{a)f{a) + g{a)f{a) - f{a)g{x) 



9{x)g{a) 

SO 

{f/9){x) - {f/g){a) 



X — a 



x — a x — aj g{x)g{a) 

for X G /, X 7^ a. Now we take the limit as x ^ a to obtain 
(iv); note that hm^^^, r \ r \ = -^r^- ■ 

V /' g{x)g{a) g^{a) 

Example 4 

Let m be a positive integer, and let h{x) = x~'^ for x ^ 0. Then 
h{x) = f{x)/g{x) where f{x) = 1 and g{x) — x'^ for all x. By the 
quotient rule, 

h\a) = " /(^)^'(^) _ a- . 0 - 1 . ma— 1 



^2 (a) a- 



2m 



-m 



= —ma 



-m— 1 



for a ^ 0. If we write n for — m, then we see the derivative of 
is nx'^~^ for negative integers n as well as for positive integers. The 
result is also trivially valid for n = 0. For fractional exponents, see 
Exercise 29.15. □ 



28.4 Theorem [Chain Rule]. 

// / is differentiable at a and g is differentiahle at f{a), then the 
composite function go f is differentiable at a and we have {gofy{a) = 
5'(/(a))-/». 

Discussion. Here is a faulty "proof" which nevertheless contains 
the essence of a valid proof. We write 

go fix)- go f (a) ^ g{f{x))-g{f{a)) f{x) - fja) 
X — a f{x) — f{a) x — a 
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for X ^ a. Since linix^a f{x) = /(a), we have 

/(a^) - /(«) y^f(a) y - f{a) ^^■'^ ^ ^ 

We also have lim^^a "^^"^^Zf^"^ = /'(«), so (1) shows (g o f)'{a) = 
g'{f{a))-f{a). 

The main problem with this "proof" is that f{x) — f{a) in Eq. (2) 
might be 0 for x arbitrarily close to a. If, however, f{x) ^ /(a) for 
X near a, then this proof can be made rigorous. If j{x) — /(a) for 
some x's near a, the "proof" cannot be repaired using (2). In fact. 
Exercise 28.5 gives an example of differentiable functions / and g for 
which lim^^^o ^^"^^(2)1/(0)^^^ meaningless. 

We now give a rigorous proof, but we will use the sequential 
definition of a limit. The proof reflects ideas in the article by Stephen 
Kenton [36]. 

Proof 

The hypotheses include the assumptions that / is defined on an 
open interval J containing a, and g is defined on an open interval 
/ containing /(a). It is easy to check g o f is defined on some open 
interval containing a (see Exercise 28.13), so by taking J smaller if 
necessary, we may assume g o f is defined on J. 

By Definitions 20.3(a) and 20.1, it suffices to consider a sequence 
{xn) in J \ {a} where lim and show 

y 9^ f{Xn) - go f{a) Ifrf^^ rff ^ /QX 

hm = g {f{a)) • / (a). (3) 

n^oo Xji — a 

For each n, let yn — f{xn)- Since / is continuous at x = a, we have 
lim^^^ = f{a). For f{xn) + /(a), 

{9of){xn) - {9of){a) ^ 9{yn) - 9U{o)) ^ fjxn) - f{a) 
Xn-a yn - f{a) Xn - a 

Case 1. Suppose f{x) ^ /(a) for x near a. Then y^ — f{xn) ^ 
/(a) for large n, so taking the limit in (4), as n ^ oo, we obtain 
{9ofna)=g'{f{a))-f{a). 
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Case 2. Suppose f{x) = /(a) for x arbitrarily close to a. Then 
there is a sequence (z^) in J\{a} such that lim^ Zn = a and f{zn) = 
/(a) for all n. Then 

f{Zn) - f{a) 0 



lim 



lim 



Zn — d n^oo Zn — d 

and it suffices to show {g o fy{a) — 0. We do have 



0, 



= 0, 

n^oo Zji — d n^oo — a 

but this only assures us that {g o fy{a) = 0 provided we know this 
derivative exists. To help us prove this, we note g\f{a)) exists and 



so the difference quotients 



9(y)-9(fia)) 

y-f{a) 



are bounded near /(a). Thus, 



replacing the open interval / by a smaller one if necessary, there is 
a constant C > 0 so that 



giy)-g{f{a)) 



Therefore 

{9° f){Xr, 



y-fia) 

i9of){a) 



<C for yel\f{a). 



Xn_ Qj 



< C 



f{xn) - f{a) 



Xn_ Qj 



for large n, (5) 



which is clear if f{xn) = /(a) and otherwise follows from Eq. (4). 
Since f\a) = 0, the right side of (5) tends to 0 as n ^ 00; thus 
the left side also tends to 0. Since (x^) is any sequence in J \ {a} 
converging to a, we conclude {g o fy{a) = 0, as desired. ■ 

It is worth emphasizing that if / is differentiable on an interval / 
and if g is differentiable on {f{x) : x G /}, then (g o fy is exactly 
the function {g^ ^ f) • f on /. 



sin(x^ + 7x) for x G M. The reader can undoubtedly 
= (3x^ + 7) cos(x^ + 7x) for X G R using some automatic 



Example 5 

Let h{x) - 
verify h'{x) 

technique learned in calculus. Whatever the automatic technique, it 
is justified by the chain rule. In this case, h — g o f where /(x) = 
x^ + 7x and g{y) — siny. Then f'{x) — 3x^ + 7 and g'{y) — cosy so 
that 



h'{x) = g{f{x))'f{x) = [cos/(x)]./(x) = [cos(x^ + 7x)].(3x2 + 7). 
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We do not want the reader to unlearn the automatic technique, but 
the reader should be aware that the chain rule stands behind it. □ 



Exercises 

28.1 For each of the following functions defined on R, give the set of 
points at which it is not different iable. Sketches will be helpful. 

(a) el^l (b) sin \x\ 

(c) I smx\ (d) \x\ + |x - 1| 

(e) \x'-l\ (f) 1x^-81 

28.2 Use the definition of derivative to calculate the derivatives of the 
following functions at the indicated points. 

(a) f{x) = at X = 2; 

(b) g{x) = X + 2 at X = a; 

(c) f{x) = cos X at X = 0; 

(d) r{x) = g±i at X = 1. 

28.3 (a) Let h{x) = = x^/^ for x > 0. Use the definition of derivative 

to prove h'{x) = ^x~^/^ for x > 0. 

(b) Let /(x) = x^/^ for X G M and use the definition of derivative 
to prove f\x) = |x~^/^ for x 7^ 0. 

(c) Is the function / in part (b) differentiable at x = 0? Explain. 

28.4 Let /(x) = x^ sin ^ for x 7^ 0 and /(O) = 0. 

(a) Use Theorems 28.3 and 28.4 to show / is differentiable at each 
a 7^ 0 and calculate f'{a). Use, without proof, the fact that 
sinx is differentiable and that cosx is its derivative. 

(b) Use the definition to show / is differentiable at x = 0 and 
/'(O) = 0. 

(c) Show f is not continuous at x = 0. 

28.5 Let /(x) = x^ sin ^ for x 7^ 0, /(O) = 0, and g{x) = x for x G M. 

(a) Observe / and g are differentiable on M. 

(b) Calculate /(x) for x = n = ±1, ±2, . . .. 

(c) Explain why linia^^o ^^'^j(2)-/(o)^^^ meaningless. 
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28.6 Let f{x) = x sin ^ for x 7^ 0 and /(O) = 0. See Fig. 19.3. 

(a) Observe / is continuous at x = 0 by Exercise 17.9(c). 

(b) Is / differentiable at x = 0? Justify your answer. 

28.7 Let f{x) = for x > 0 and f{x) = 0 for x < 0. 

(a) Sketch the graph of /. 

(b) Show / is differentiable at x = 0. Hint: You wih have to use 
the definition of derivative. 

(c) Calculate f on R and sketch its graph. 

(d) Is continuous on M? differentiable on M? 

28.8 Let f{x) = for x rational and f{x) = 0 for x irrational. 

(a) Prove / is continuous at x = 0. 

(b) Prove / is discontinuous at all x 7^ 0. 

(c) Prove / is differentiable at x = 0. Warning: You cannot simply 
claim f'{x) = 2x. 

28.9 Let h{x) = {x^ + 13xy. 

(a) Calculate h\x). 

(b) Show how the chain rule justifies your computation in part (a) 
by writing h = g o f for suitable / and g. 

28.10 Repeat Exercise 28.9 for the function h{x) = (cosx + e^)^^. 

28.11 Suppose / is differentiable at a, ^ is differentiable at /(a), and h is 
differentiable at ^ o /(a). State and prove the chain rule for {ho g o 
fy{a). Hint: Apply Theorem 28.4 twice. 

28.12 (a) Differentiate the function whose value at x is cos(e^^~^^). 

(b) Use Exercise 28.11 or Theorem 28.4 to justify your computation 
in part (a). 

28.13 Show that if / is defined on an open interval containing a, if g is 
defined on an open interval containing /(a), and if / is continuous 
at a, then g o f is defined on an open interval containing a. 

28.14 Suppose / is differentiable at a. Prove 

(a) lim.^o i(^^±^^^ = f'{a), (b) lim.^o /(°+'')-/(°-'') = /'(„). 
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28.15 Prove Leibniz' rule 



(/5)(")(a) = f^("Vw(a)5("-'^)(a) 



provided both / and g have n derivatives at a. Here hS^^ signifies 
the jth derivative of h so that /i^^^ = h, h^^^ = h\ h^'^^ = h" , etc. 
Also, (^) is the binomial coefficient that appears in the binomial 
expansion; see Exercise 1.12. Hint: Use mathematical induction. For 
n = 1, apply Theorem 28.3(iii). 

28.16 Let / be a function defined on an open interval / containing a. Show 
f {a) exists if and only if there is a function e{x) defined on / such 
that 

f{x) — f{a) = {x — a)[f\a) — e{x)] and lim e{x) = 0. 



§29 The Mean Value Theorem 

Our first result justifies the following strategy in calculus: To find the 
maximum and minimum of a continuous function / on an interval 
[a, 6] it suffices to consider (a) the points x where f\x) = 0; (b) the 
points where / is not different iable; and (c) the endpoints a and b. 
These are the candidates for maxima and minima. 

29.1 Theorem. 

// / is defined on an open interval containing xq, if f assumes its 
maximum or minimum at xq, and if f is differentiahle at then 
f{xo) = 0. 

Proof 

We suppose / is defined on (a, b) where a < xq < b. Since either / 
or — / assumes its maximum at xq, we may assume / assumes its 
maximum at xq. 

Assume first that f\xo) > 0. Since 

f {xo) lim , 

x^XQ X — Xq 
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there exists 6 > 0 such that a<xo — 6<XQ + 6<b and 

0<\x-xo\<S imphes /(^) ~ /(^q) > Q; (1) 

X — Xq 

see Corollary 20.7. If we select x so that xq < x < xq + then (1) 
shows f{x) > /(xo), contrary to the assumption that / assumes its 
maximum at xq. Likewise, if f^{xo) < 0, there exists 6 > 0 such that 

0<\x-xo\<6 implies /(^) " /(^q) < q. (2) 

X — xo 

If we select x so that xq — 5 < x < xq, then (2) implies /(x) > /(xq), 
again a contradiction. Thus we have /'(xq) =0. ■ 

Our next result is fairly obvious except for one subtle point: one 
needs to know or believe that a continuous function on a closed 
interval assumes its maximum and minimum. We proved this in 
Theorem 18.1 using the Bolzano- Weierstrass theorem. 

29.2 RoUe's Theorem. 

Let f be a continuous function on [a, b] that is differentiable on (a, b) 
and satisfies f{a) = f{b). There exists [at least one] x in {a,b) such 
that f{x) = 0. 

Proof 

By Theorem 18.1, there exist xq, yo G [a, b] such that /(xq) < /(x) < 
f{yo) for all x G [a, b]. If xq and yo are both endpoints of [a, 6], then 
/ is a constant function [since /(a) = and f\x) = 0 for all 

X G {a,b). Otherwise, / assumes either a maximum or a minimum 
at a point x in (a, 6), in which case /'(x) = 0 by Theorem 29.1. ■ 

The Mean Value Theorem tells us that a differentiable function 
on [a, b] must somewhere have its derivative equal to the slope of the 
line connecting {a^f{a)) to {b^f{b))^ namely ^^^^z^^- See Fig. 29.1. 



29.3 Mean Value Theorem. 

Let f be a continuous function on [a, b] that is differentiable on (a, 6). 
Then there exists [at least one] x in (a, b) such that 




Note that Rolle's Theorem is the special case of the Mean Value 
Theorem where /(a) = f{b). 

Proof 

Let L be the function whose graph is the straight line connect- 
ing {a^f{a)) to (6, i.e., the dotted line in Fig. 29.1. Observe 
L(a) = /(a), L{b) = f{b) and L\x) = ^^^^E^ for ah x. Let 
g{x) = /(x) — L{x) for x G [a, 6]. Clearly ^ is continuous on [a, 6] 
and differentiable on (a, 6). Also ^(a) = 0 = ^(^), so g^{x) = 0 
for some x G (a, 6) by Rolle's Theorem 29.2. For this x, we have 

f{x)^L^{x)^^^. m 

29.4 Corollary. 

Let f be a differentiable function on (a, b) such that f\x) — 0 for all 
X G (a, 6). T/ien f is a constant function on {a,b). 

Proof 

If / is not constant on (a, 6), then there exist xi^X2 such that 
a < xi < X2 < b and /(xi) ^ f{x2)' 

By the Mean Value Theorem, for some x G (xi, X2) we have f'{x) = 

/(x2)-/(xi) / Q contradiction. ■ 

X2—X1 ' ' 
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29.5 Corollary. 

Let f and g be differentiable functions on (a, b) such that f — g' on 
(a^b). Then there exists a constant c such that f{x) = g{x) + c for 
all X G (a, b). 

Proof 

Apply Corollary 29.4 to the function f — g. ■ 

Corollary 29.5 is important for integral calculus because it guar- 
antees all antiderivatives, alias indefinite integrals, for a function 
differ by a constant. Old integral tables and modern computational 
software programs provide formulas like 

j x^ cos xdx — 2x cos x + (x^ — 2) sin x + C 

It is straightforward to show the derivative of each function 2x cos x+ 
(x^ — 2) sinx + C is in fact x^ cosx. Corollary 29.5 shows that these 
are the only antiderivatives of x^ cos x. 

We need some terminology in order to give another useful 
corollary of the Mean Value Theorem. 

29.6 Definition. 

Let / be a real-valued function defined on an interval /. We say / is 
strictly increasing on I if 

xi,X2 G / and xi < X2 imply f{xi) < /(X2), 
strictly decreasing on I if 

xi,X2 G / and xi < X2 imply f{xi) > /(X2), 
increasing on I if 

xi,X2 G / and xi < X2 imply f{xi) < /(X2), 
and decreasing on I if 

xi,X2 G / and xi < X2 imply f{xi) > f{x2). 



Example 1 

The functions on R and y/x on [0, 00) are strictly increasing. The 
function cosx is strictly decreasing on [0,7r]. The signum function 
and the postage-stamp function in Exercises 17.10 and 17.16 are 
increasing functions but not strictly increasing functions. □ 
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29.7 Corollary. 

Let f be a differentiable function on an interval {a,b). Then 

(i) / is strictly increasing if f\x) > 0 for all x G (a, 6); 

(ii) / is strictly decreasing if f\x) < 0 for all x G (a, 6); 

(iii) / is increasing if f^{x) > 0 for all x G (a, 6); 

(iv) / is decreasing if f^{x) < 0 for all x G (a, 6). 

Proof 

(i) Consider xi,X2 where a < xi < X2 < b. By the Mean Value 
Theorem, for some x G {xi,X2) we have 

^^"^^ - f^^'^ = fix) > 0. 

X2 - X\ 

Since X2 — x\ > 0, we see f{x2) — f{xi) > 0 or f{x2) > f{xi). 
The remaining cases are left to Exercise 29.8. ■ 



Exercise 28.4 shows the derivative of a differentiable function 
/ need not be continuous. Nevertheless, like a continuous function, 
has the intermediate value property [see Theorem 18.2]. 

29.8 Intermediate Value Theorem for Derivatives. 

Let f be a differentiable function on (a^b). If a < xi < X2 < b, and 
if c lies between f\xi) and f\x2), there exists [at least one] x in 
(xi,X2) such that f\x) = c. 

Proof 

We may assume f'{xi) < c < f'{x2)' Let g{x) — f{x)— cx for 
X G (a, 6). Then we have g\xi) < 0 < g\x2). Theorem 18.1 shows g 
assumes its minimum on [xi,X2] at some point G [xi,X2]. Since 

g [xi) lim < 0, 

y^xi y — Xi 

g{y)—g{xi) is negative for y close to and larger than xi. In particular, 
there exists yi in (xi,X2) such that g{yi) < g{xi). Therefore g does 
not take its minimum at xi, so we have xq ^ xi. Similarly, there 
exists y2 in (xi,X2) such that g{y2) < g{x2)^ so xq ^ X2. We have 
shown xo is in (xi,X2), so g'{x{)) = 0 by Theorem 29.1. Therefore 
/'(xo) = g\xQ) + c = c. ■ 
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We next show how to differentiate the inverse of a differentiable 
function. Let / be a one-to-one differentiable function on an open 
interval /. By Theorem 18.6, / is strictly increasing or strictly de- 
creasing on /, and by Corollary 18.3 the image /(/) is an interval J. 
The set J is the domain of and 

f-^of{x)=x for X G /; f^f~^{y)=y for y G J. 

The formula for the derivative of is easy to obtain [or remember] 
from the Chain Rule: x = o /(x), so 

l = ir'y{f{x))-f'{x) for all xel. 

If xq E I and i/q = /{xq), then we can write 1 = {f~^y{yo) ' /'(^o) oi" 

This is not a proof because the Chain Rule requires the functions, 
and / in this case, be differentiable. We assumed / is differentiable, 
but we must prove is also differentiable. In addition, observe 
f'{xo) might be 0 [consider f{x) — x^ at xq = 0], so our final result 
will have to avoid this possibility. 

29.9 Theorem. 

Let f he a one-to-one continuous function on an open interval I , and 
let J = /(/). // / is differentiable at xq E I and if f'{x{)) ^ 0^ then 
f~^ is differentiable at i/q = fixo) and 

Proof 



Note that J is also an open interval. We have lim^^^^^Q 



fix)-fixo) ^ 
x—xq 

f\xo). Since f\xo) ^ 0 and since f{x) ^ f{xo) for x near xq, we 
can write 



1 . X Xq 1 . . 

see Theorem 20.4(iii). Let e > 0. By (1) and Corollary 20.7, there 
exists S > 0 such that 



0 < \x — xo\ < 6 implies 



X — Xq 



fix) - fixo) fixo) 



< e. (2) 
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Let g = and observe that g is continuous at i/q by Theorems 18.6 
and 18.4 [or Exercise 18.11]. Hence there exists rj > 0 [lower case 
Greek eta] such that 

0 <\y -yo\ <r] imphes \g{y) - g{yo)\ < 6, i.e., \g{y) - xo\ < 6. 

(3) 

Combining (3) and (2) we obtain 

g{y) -xq 1 



0 < 1^ — ^o| < V imphes 



Since , = 9iy)-9iyo) ^^is shows 

f{9{y))-f{xo) y-yo ' 

hm ^'^^^ ~ ^'^^^^ - 



f{g{y)) - fM r{xo) 



< e. 



y^yo y-yo f\xo)' 
Hence g\yo) exists and equals jr^^- • 

Example 2 

Let n be a positive integer, and let g{y) = ^j/^ = y^^^. If n is even, the 
domain of g is [0, oc) and, if n is odd, the domain is R. In either case, 
g is strictly increasing and its inverse is f{x) = x^; here dom(/) = 
[0, oo) if n is even. Consider yo in dom(^) where yo ^ 0, and write 
yo = where xq G dom(/). Since /^{xq) = nxQ~^, Theorem 29.9 
shows 

3 ^^O) = = {n-l)/n = • 

This shows the function g is differentiable for y ^ 0 and the rule 
for differentiating holds for exponents of the form 1/n; see also 
Exercise 29.15. □ 



Theorem 29.9 applies to the various inverse functions encountered 
in calculus. We give one example. 

Example 3 

The function f{x) — sinx is one-to-one on [— f , f ], and it is tradi- 
tional to use the inverse g of f restricted to this domain; g is usually 
denoted Sin"-*^ or arcsin. Note that dom(^) = [—1, 1]. For yo = sinxo 
in (-1, 1) where xq G (-f , f ), Theorem 29.9 shows g'{yo) = 
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Since 1 = sin^ xq + cos^ xq = Vq ^ cos^ xq and cosxq > 0, we may 
write 



g'iyo) = ^ ^ for yo ^ (-1, 1). 
vi-2/0 



Exercises 

29.1 Determine whether the conclusion of the Mean Value Theorem holds 
for the following functions on the specified intervals. If the conclusion 
holds, give an example of a point x satisfying (1) of Theorem 29.3. 
If the conclusion fails, state which hypotheses of the Mean Value 
Theorem fail. 

(a) on [—1,2], (b) s'mx on [0,7r], 



The function sgn is defined in Exercise 17.10. 

29.2 Prove | cos x — cos y | < \x — y\ for all y G M. 

29.3 Suppose / is differentiable on M and /(O) = 0, /(I) = 1 and /(2) = 



(a) Show f'{x) = ^ for some x G (0, 2). 

(b) Show f{x) = \ for some x G (0,2). 

29.4 Let / and g be differentiable functions on an open interval /. 
Suppose a, 6 in / satisfy a < b and f{a) = f{b) = 0. Show 
f'{x) + f{x)g'{x) = 0 for some x G (a, 6). Hint: Consider h{x) = 



29.5 Let / be defined on M, and suppose \f{x) — f{y)\ < {x — y^ for all 
X, y G M. Prove / is a constant function. 

29.6 Give the equation of the straight line used in the proof of the Mean 
Value Theorem 29.3. 

29.7 (a) Suppose / is twice differentiable on an open interval / and 

f"{x) = 0 for all X e I. Show / has the form f{x) = ax for 
suitable constants a and b. 



(c) \x\ on [-1,2], 
(e) ^on [1,3], 



(d) ion [-1,1], 
(f) sgn(x) on [-2,2]. 



1. 



(b) Suppose / is three times differentiable on an open interval / 
and f"^ = 0 on /. What form does / have? Prove your claim. 
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29.8 Prove (ii)-(iv) of Corollary 29.7. 

29.9 Show ex < for all x G M. 

29.10 Let f{x) = sin(^) + f for x 7^ 0 and /(O) = 0. 

(a) Show f\0) > 0; see Exercise 28.4. 

(b) Show / is not increasing on any open interval containing 0. 

(c) Compare this example with Corollary 29.7(i). 

29.11 Show sinx < X for all x > 0. Hint: Show /(x) = x— sinx is increasing 
on [0, oc). 

29.12 (a) Show x < tanx for all x G (0, f ). 

(b) Show is a strictly increasing function on (0, |^). 

(c) Show X < 1^ sinx for X G [0, 

29.13 Prove that if / and g are differentiable on M, if /(O) = ^(0) and if 
f (x) < g'{x) for all x G M, then /(x) < g{x) for x > 0. 

29.14 Suppose / is differentiable on M, 1 < f\x) < 2 for x G M, and 
/(O) = 0. Prove x < /(x) < 2x for ah x > 0. 

29.15 Let r be a nonzero rational number ^ where n is a positive integer, 
m is any nonzero integer, and m and n have no common factors. 
Let h{x) = x^ where dom(/i) = [0, 00) if n is even and m > 0, 
dom(/i) = (0, oc) if n is even and m < 0, dom(/i) = M if n is odd 
and m > 0, and dom(/i) = R \ {0} if n is odd and m < 0. Show 
h'{x) = rx^~^ for x G dom(/i), x 7^ 0. Hint: Use Example 2. 

29.16 Use Theorem 29.9 to obtain the derivative of the inverse g = 
Tan~-^ = arctan of / where /(x) = tanx for x G (— f , f ). 

29.17 Let / and g be differentiable on an open interval / and consider 
a G I. Define /i on / by the rules: h{x) = /(x) for x < a, and 
h{x) = g{x) for x > a. Prove h is differentiable at a if and only if 
both /(a) = g{a) and f\a) = g\a) hold. Suggestion: Draw a picture 
to see what is going on. 

29.18 Let / be differentiable on M with a = sup{|/'(x)| : x G M} < 1. 

(a) Select 5o G M and define Sn = f{sn-i) for n > 1. Thus si = 
/(<5o), S2 = /(^i), etc. Prove {sn) is a convergent sequence. 
Hint: To show that {sn) is Cauchy, first show l^^+i — 5^1 < 

Ci\Sn — Sn-l \ for U > 1. 

(b) Show / has a fixed pointy i.e., f{s) = s for some s in M. 



§30. * 



HospitaPs Rule 241 



§30 * L'HospitaPs Rule 



In analysis one frequently encounters limits of the form 



where s signifies a, a^, a~, oo or — oo. See Definition 20.3 concerning 
such limits. The limit exists and is simply j™"^^^ provided the 
limits lim^^^s f{x) and lim^^^g g{x) exist and are finite and provided 
limx^s 9{x) ^ 0; see Theorem 20.4. If these limits lead to an inde- 
terminate form such as ^ or then L'Hospital's rule can often be 
used. Moreover, other indeterminate forms, such as oo — oo, 1^, oo^, 
0^ or 0 • oo, can usually be reformulated so as to take the form ^ or 
^; see Examples 5-9. Before we state and prove L'Hospital's rule, 
we will prove a generalized mean value theorem. 

30.1 Generalized Mean Value Theorem. 

Let f and g be continuous functions on [a, b] that are differentiable 
on (a^b). Then there exists [at least one] x in {a,b) such that 



This result reduces to the standard Mean Value Theorem 29.3 
when g is the function given by g{x) = x for all x. 

Proof 

The trick is to look at the difference of the two quantities in (1) and 
hope Rolle's Theorem will help. Thus we define 



h{a) = fiaMb) - g{a)] - g{a)[f{b) - /(a)] = f{a)g{b) - g{a)f{b) 



h{h) = f{h)[g{h) - g{a)] - g{h)[f{h) - f{a)] = -f{b)g{a) + g{b)f{a) = h{a). 



nx)[g{b)-g{a)]^g'{x)[f{b)-f{a)]. 



(1) 



it suffices to show h' 




and 



Clearly h is continuous on [a, b] and differentiable on (a, 6), so Rolle's 
Theorem 29.2 shows h\x) = 0 for at least one x in (a, 6). ■ 
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Our proof of L'Hospital's rule below is somewhat wordy but is 
really quite straightforward. It is based on the elegant presentation 
in Rudin [62]. Many texts give more complicated proofs. 



30.2 L'HospitaPs Rule. 

Let s signify a, a^^ a~ , oo or — oo where a G M; and suppose f and 
g are differentiable functions for which the following limit exists: 



If 



or if 



then 



lim ^=L. (1) 

lim f{x) = lim g{x) = 0 (2) 

X^S X^S 

lim = +00, (3) 



lim 44 = ^- (4) 



x^s g(^x) 



Note that the hypothesis (1) includes some implicit assumptions: 
/ and g must be defined and differentiable "near" s and g'{x) must be 
nonzero "near" s. For example, if \Ym^^^+ exists, then there is 
an interval (a, h) on which / and g are differentiable and g' is nonzero. 
The requirement that g^ be nonzero is crucial; see Exercise 30.7. 



Proof 

We first make some reductions. The case of Yvuix^a follows from the 
cases \Ymrj.^^+ and lim^^^-, since \imx^ah{x) exists if and only if 
the limits lim3,^^+ h{x) and lim^,^^- h{x) exist and are equal; see 
Theorem 20.10. In fact, we restrict our attention to \imrj.^^+ and 
Xmix^-oo^ since the other two cases are treated in an entirely analo- 
gous manner. Finally, we are able to handle these cases together in 
view of Remark 20.11. 
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We assume a G R or a = — oo. We will show that if — oo < L < oo 
and Li > L, then there exists ai > a such that 

ffx) 

a < X < ai implies ——— < Li. (5) 

A similar argument [which we omit] shows that if — oo < L < oc and 
L2 < I/, then there exists a2 > a such that 

ffx) 

a < X < a2 implies — — > L2. (6) 

We now show how to complete the proof using (5) and (6); (5) will 
be proved in the next paragraph. If L is finite and e > 0, we can 
apply (5) to Li = L + e and (6) to L2 = L — e to obtain ai > a and 
a2 > a satisfying 

a < X < ai implies < L + e, 

a < X < a2 implies > L — e. 

Consequently ii a = min{ai, 0^2} then 

fix) 



a < X < a implies 



L 



in view of Remark 20.11 this shows lim^^^+ = L [if a = — 00, 
then a+ = —00]. If L = —00, then (5) and the fact that Li is 
arbitrary show limx^^-\- = — 00. If L = 00, then (6) and the fact 

that L2 is arbitrary show \im^^fj^+ = 00. 

It remains for us to consider Li > L > —00 and show there 
exists ai > a satisfying (5). Let (a, b) be an interval on which / and 
g are differentiable and on which g^ never vanishes. Theorem 29.8 
shows either g^ is positive on (a, 6) or else g^ is negative on (a, 6). 
The former case can be reduced to the latter case by replacing g 
by —g. So we assume g\x) < 0 for x G (a, 6), so that g is strictly 
decreasing on (a, b) by Corollary 29.7. Since g is one-to-one on (a, 6), 
g{x) can equal 0 for at most one x in (a, 6). By choosing b smaller if 
necessary, we may assume g never vanishes on (a, 6). Now select K 



244 ^' Differentiation 



SO that L < K < Li. By (1) there exists a > a such that 

a < X < a imphes . < K. 

li a < X < y < then Theorem 30.1 shows 

/(^) - f{y) ^ f{z) 

g{x) - g{y) g'{z) 

Therefore 



for some z G (x^y). 



f(x) - f(y) 

a<x <y <a imphes < K. (7) 

9[x) - g{y) 

If hypothesis (2) holds, then 

fix) - f{y) ^ 

x^a+ g{x) - g{y) g{y) ' 

so (7) shows 

< K < Li for a<y <a; 

hence (5) holds in this case. If hypothesis (3) holds, then lim^^^+ 
g{x) = +00 since g is strictly decreasing on (a, 6). Also g{x) > 0 for 
X G (a, 6) since g never vanishes on (a, 6). We multiply both sides 
of (7) by ^^^](~^^^^ ; which is positive, to see 

a < X < y < a implies < K • ^ — ——^ — 

g{x) g{x) 

and hence 

f{x) g{x)-g{y) ^ f{y)^j^ , f{y)-Kg{y) ^ 

g{x) g{x) g{x) g{x) 

We regard y as fixed and observe 

x^a+ g[x) 
Hence there exists a2 > a such that 0^2 < ^ < « and 

f(x) 

a < X < a2 implies < K < Li. 

Thus again (5) holds. ■ 
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Example 1 

If we assume familiar properties of the trigonometric functions, then 
hm^^^o is easy to calculate by L'Hospital's rule: 

^ sinx ^ cosx , . . . 

lim = lim = cos(O) = 1. (1) 

x^O X x^O 1 

Note f{x) = sinx and g{x) — x satisfy the hypotheses in Theo- 
rem 30.2. This particular computation is really dishonest, because 
the limit (1) is needed to prove the derivative of sinx is cosx. This 
fact reduces to the assertion that the derivative of sinx at 0 is 1, i.e., 
to the assertion 

. sin X — sin 0 . . sin x 
lim = lim = 1. 

x^O X — 0 x^Q X □ 



Example 2 

We calculate lim^^^o ^- L'Hospital's rule will apply provided the 

limit lima^^o ~2x'' ^^i^ts. but = ^'^i^ 1™^^ ~\ 

by Example 1. We conclude 

^. cosx — 1 1 
lim 



x^o x^ 2 □ 



Example 3 

2 

We show lim^^^oo ^ = 0. As written we have an indeterminate 
of the form ^. By L'Hospital's rule, this limit will exist provided 
lim^^^oo exists and by L'Hospital's rule again, this limit will 
exist provided lim^^^oo exists. The last limit is 0, so we conclude 
lim^^oo ^ = 0. □ 

Example 4 

Consider lim^^o+ ^^^^ if i^ exists. By L'Hospital's rule, this appears 
to be 

lim = +OC 

x^0+ 1 

and yet this is incorrect. The difficulty is that we should have checked 
the hypotheses. Since lim^^o+l^ggX = — oo and lim^^o+ ^ = 0? 
neither of the hypotheses (2) or (3) in Theorem 30.2 hold. To 
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find the limit, we rewrite ^^^^ as — 1^^^^^, It is easy to show 
lim3,^o+ ^^^""i^^^^ will agree with lim^^^oo V loge V provided the lat- 
ter limit exists; see Exercise 30.4. It follows that lim3,^o+ ^^^^ ^ 

- lim^^oo y loge y = O 

The next five examples illustrate how indeterminate limits of 
various forms can be modified so that L'Hospital's rule applies. 

Example 5 

Consider lim3,^o+ 3:^loggX. As written this limit is of the indetermi- 
nate form 0 • (— oo) since lim^^o+ ^ = 0 and lim3,^o+ loge x = —oo. 
By writing x logg x as ^^^^ we obtain an indeterminate of the form 
so we may apply L'Hospital's rule: 

lim xloggX = lim — ^ — = lim = — lim x = 0. 

We could also write x loo;^ x as ttt^ — to obtain an indeterminate 

of the form ^. However, an attempt to apply L'Hospital's rule only 
makes the problem more complicated: 

X 1 
lim xlog^x = lim — ^ — = lim — j = — lim x(loggX)^. 

X^0+ X^0+ ^ X^0+ —r, ^— To X^0+ 

loge a; x{\og^x)^ □ 



Example 6 

The limit lim^^o+ Is of the indeterminate form 0^. We write x^ as 
gxioggX [remember x = e^^^^^^^j and note that lim^^o+ ^loge a:^ = 0 by 
Example 5. Since g{x) — is continuous at 0, Theorem 20.5 shows 

lim = lim e^^^Se^ = L 
x^0+ x^o+ □ 



Example 7 

The limit lim^^^oo ^^^^ is of the indeterminate form oo^. We write 
x^/^ as e^^^^^^^/^ . By L'Hospital's rule 

lim = hm i = 0. 

x^oo X x^oo 1 

Theorem 20.5 now shows lim^^^oo x'^^^ = = L □ 
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Example 8 

The limit liuix^ooi^ — is indeterminate of the form 1^. Since 



1 _ i ] = gXiog,(i-i/x) 

X 



we evaluate 



1\ logjl-^) (1--)" X 
lim X logg 1 = lim — = lim ^ ^^^^^ — 



x^oo \ X / x^oo — x^oo —X 

X 

= lim - ( 1 - = -1. 

x^oo \ X I 



So by Theorem 20.5 we have 

lim (l - =e-\ 

x^oo y X J 

as should have been expected since lim^^oo(l — = - D 
Example 9 

Consider lim^^^o h{x) where 

h(x) = — i = (e^ - l)-i - x-^ for x^O. 

— 1 X 

Neither of the limits lima^^o(e^ — l)""*^ lim^^^o ^"''^ exists, so 
lim^^^o h{x) is not an indeterminate form as written. However, 
lim3,^o+ ^{x) is indeterminate of the form oc — oc and lim^^g- ^(^) 
is indeterminate of the form (— oc) — (— oc). By writing 

, , , X - + 1 

ri(x) = — — 

^ ^ x(e^ - 1) 

the limit lim^^^o ^(^) becomes an indeterminate of the form ^. By 
L'Hospital's rule this should be 

lim 



x^o xe^ + — 1 ' 

which is still indeterminate ^. Note xe^ + — 1 7^ 0 for x 7^ 0 
so that the hypotheses of Theorem 30.2 hold. Applying L'Hospital's 
rule again, we obtain 

-e^ 1 

lim 



x^o xe^ + 2e^ 2 
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Note we have xe^ + 2e^ ^ 0 for x in (—2,00). We conclude 



Exercises 

30.1 Find the following limits if they exist. 

(a) lim^^o (b) lim^^o 

(c) limaj_^oo (d) lima^^o 



30.2 Find 



30.3 Find 



a) lima, 
c) lim 



the following limits if they exist. 



a) lima^^o 
c) lim; 



sm x — x 
1 



the following limits if they exist. 



x^0+ 



1+COS X 



/TTx- 



(b) hm.^o ^ 
(d) lima^^o (cos X 



Ajx^ 



(b) lima,^o< 
(d) lima^^o 



^sin(l/a:) 
1— cos 2a; — 2a;^ 



30.4 Let / be a function defined on some interval (0,a), and define 

= 0 if a = oc. Show 



g(\j) = /(^) for y G (a ""^,00); here we set a 



lima,^o+ /(^) exists if and only if lim^y- 
these limits are equal. 



, g(^y) exists, in which case 



30.5 Find the limits 

(a) lim,^o(l + 2x)i/- 

(c) lim3,^oo(e^ 



(b) lim^_ 



30.6 Let / be differentiable on some interval (c, 00) and suppose 
lima,^oo[/(^) + /'(^)] = ^7 where L is finite. Prove lima^^oo /(^) = ^ 
and lim,^^ f {x) = 0. mnt: f{x) = 

30.7 This example is taken from [65, p. 188] and is due to Otto Stolz [64]. 
The requirement in Theorem 30.2 that g'{x) 7^ 0 for x "near" 5 is 
important. In a careless application of L 'Hospital's rule in which the 
zeros of g' "cancel" the zeros of erroneous results can be obtained. 
For X G M, let 



/(x) = X + cosxsinx and ^(x) = e®^"^(x + cosx sinx). 

(a) Show lim^^^cx) /(^) hma^^cx) g{x) +oc. 

(b) Show f'{x) = 2(cosx)^ and g'{x) = e®^"^ cosx[2 cosx + /(x)]. 
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(c) Show = if eosx 7^ 0 and x > 3. 

(d) Show lim^^oc l^coTxlTix) = 0 and yet the hmit Hm^^oo fg} 
does not exist. 



§31 Taylor's Theorem 

31.1 Discussion. 

Consider a power series with radius of convergence R > 0 [R may 
be +(X)]: 

oo 

= J^a.x^ (1) 

k=0 

By Theorem 26.5, / is differentiable in the interval \x\ < R and 

oo 

k=i 

The same theorem shows is differentiable for |x| < i? and 

oo 
k=2 

Continuing in this way, we find the nth derivative /^^^ exists for 
\x\ < R and 

oo 

= ^ - 1) • • • (fc - n + l)afca;'=-". 

k=n 

In particular, 

/W(0) = n(n - 1) • • • (n - n + l)a^ = n!a^. 

This relation even holds for n = 0 if we make the convention /^^^ = / 
and recall the convention 0! = 1. Since f^^\0) = k\ak, the original 
power series (1) has the form 

/(^)=f;^^^^'' N<^- (2) 

k=0 
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As suggested at the end of §26, we now begin with a function / 
and seek a power series for /. The last paragraph shows / should pos- 
sess derivatives of all orders at 0, i.e., /'(O), /''(O), /'^'(O), . . . should 
all exist. For such /, formula (2) might hold for some i? > 0, in which 
case we have found a power series for /. □ 

One can consider Taylor series that are not centered at 0, just as 
we did with the power series in Example 7 on 190. 

31.2 Definition. 

Let / be a function defined on some open interval containing c. If / 
possesses derivatives of all orders at c, then the series 



-ix-c)" (1) 



^ k\ 

k=0 

is called the Taylor series for f about c. For n > 1, remainder Rn{x) 
is defined by 



R^{x) = f{x)-Y,'-^i^-cf. (2) 

Of course the remainder depends on / and c, so a more ac- 
curate notation would be something like Rn{f]C]x). The remainder 
is important because, for any x, 

f(x) = y ^ ^) \ x - cf if and only if lim RJx) = 0. 

k=0 

We will show in Example 3 that / need not be given by its Taylor 
series, i.e., that lim^^oo Rn{x) = 0 can fail. Since we want to know 
when / is given by its Taylor series, our various versions of Taylor's 
Theorem all concern the nature of the remainder R^. 

31.3 Taylor's Theorem. 

Let f be defined on (a^b) where a < c < b; here we allow a = — oo 
or b = oo. Suppose the nth derivative /^^^ exists on (a^b). Then for 
each X ^ c in (a, 6) there is some y between c and x such that 

Rn{x) = ^^{x-cr. 
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The proof we give is due to James Wolfe-^ [71]; compare 
Exercise 31.6. 

Proof 

Fix X ^ c and n > 1. Let M be the unique solution of 

and observe we need only show 

f(^)(y) = M for some y between c and x. (2) 

[To see this, replace M by f^^\y) in Eq. (1) and recall the definition 
of Rn{x).] To prove (2), consider the difference 

.(') = E^('-)'>^ -/(')■ (3) 

k=0 

A direct calculation shows g{c) = 0 and g^^\c) = 0 for A; < n. Also 
g{x) = 0 by the choice of M in (1). By Rolle's theorem 29.2 we 
have g'{xi) — 0 for some xi between c and x. Since g\c) = 0, a 
second application of Rolle's theorem shows g"{x2) = 0 for some X2 
between c and xi. Again, since g'^{c) = 0 we have g"\x'i) — 0 for 
some X3 between c and X2. This process continues until we obtain Xji 
between c and Xn-i such that g^^\xn) = 0. From (3) it follows that 
^W(t) = M- f^'^Xt) for all t e (a, 6), so (2) holds with y = Xn. ■ 

31.4 Corollary. 

Let f be defined on (a, 6) where a < c < b. If all the derivatives /^^^ 
exist on (a, b) and are bounded by a single constant C , then 

lim Rn{x) — 0 for all x G (a, 6). 

Proof 

Consider x in (a, 6). From Theorem 31.3 we see 

C 

\Rn{x)\ < —:\x - for all n. 



^My undergraduate real analysis teacher in 1954-1955. 
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1^ ^1 n 

Since lim^^oo = 0 by Exercise 9.15, we conclude lim^^oo 

Rn{x) - 0. ■ 

Example 1 

We assume the familiar differentiation properties of e^, sinx, etc. 
(a) Let f{x) = for x G R. Then f'^'^\x) = for ah n = 
0,1,2,..., so f^^\0) = 1 for all n. The Taylor series for 
about 0 is 

For any bounded interval (— M, M) in R all the derivatives of 
/ are bounded [by e^, in fact], so Corollary 31.4 shows 



oo ^ 

= V 77^^ for all X G M. 



k=0 



(b) If f{x) = sinx for x G R, then 



cosx n = 1, 5, 9, . . . 

sinx n = 2, 6, 10, . . . 

cosx n = 3, 7, 11, . . . 

sinx n = 0, 4, 8, 12, ... : 



thus 



1 n = 1,5,9,... 



/(-)(0)=<^ -1 n = 3,7,11,... 
[ 0 otherwise. 

Hence the Taylor series for sin x about 0 is 
The derivatives of / are all bounded by 1, so 

oo (_-l)k 

sinx = y , \ ' for all x eR. 

{2k + 1)1 □ 
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Example 2 

In Example 2 of §26 we used Abel's theorem to prove 
^ . 111111 

Here is another proof, based on Taylor's Theorem. Let f{x) = 
logg(l + x) for X G (— 1, oc). Differentiating, we find 

fix) = {i+xr\ fix) = -{i+xr\ fix) = 2(i+x)-3, 

etc. A simple induction argument shows 

/W(x) = (-l)^+i(n-l)!(l + x)-^ for n>l. (2) 

In particular, /^^^(O) = (— l)^+-'^(n — 1)!, so the Taylor series for / 
about 0 is 

, x2 X^ X^ X^ 

k=l 

We also could have obtained this Taylor series using Example 1 in 
§26, but we need formula (2) anyway. We now apply Theorem 31.3 
with a = —1, b = +00, c = 0 and x — 1. Thus for each n there exists 
Vn e (0, 1) such that Rn{l) = Equation (2) shows 

hence 

1 1 

l^n(l)| = 7^— Ti— < - for ah n. 

(1 + ynrn n 

Therefore lim^^oo^n(l) = 0, so the Taylor series for /, evaluated 
at X = 1, converges to /(I) = logg 2, i.e., (1) holds. □ 



The next version of Taylor's theorem gives the remainder in inte- 
gral form. The proof uses results from integration theory that should 
be familiar from calculus; they also appear in the next chapter. 

31.5 Taylor's Theorem. 

Let f be defined on (a, 6) where a < c < b, and suppose the nth 
derivative /^^^ exists and is continuous on {a,b). Then for x G (a, 6) 
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we have 

\n-l 



Rn{^) = £ Tiy^ f^''\t)dt. (1) 
Proof 

For n = 1, Eq. (1) asserts 

Ri{x) ^ f{x) - f{c) = jy'{t)dt- 

this holds by Theorem 34.1. For n > 2, we repeatedly apply 
integration by parts, i.e., we use mathematical induction. So, as- 
sume (1) above holds for some n, n > 1. We evaluate the integral in 
(1) by Theorem 34.2, using u{t) = f^'^Xt), v'{t) = ^^^^ 
u\t) = /(^+^)(^) and v{t) = We obtain Rn{x) 



u{x)v{x) — u{c)v{c) — J v{t)u{t) dt 

/W(^).0 + /W(c)^^^+ nJ^^fi-+^)(t)dt. (2) 



nl n\ 
The definition of in Definition 31.2 shows 

= Rr,{x) - ^-^{x - cT- (3) 
hence from (2) we see that (1) holds for n + 1. ■ 

31.6 Corollary. 

// / is as in Theorem 31.5; then for each x in (a, b) different from c 
there is some y between c and x such that 

i?„(x) = (x-c).^^^^^/W(y). (1) 

This form of is known as Cauchy's form of the remainder. 
Proof 

We suppose x < c, the case x > c being similar. The Intermediate 
Value Theorem for Integrals 33.9 shows 
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for some y in (x,c). Since the integral in (2) equals —Rn{x) by 
Theorem 31.5, formula (1) holds. ■ 



Recall that, for a nonnegative integer n, the binomial theorem 
tells us 



where (q) = 1 and 



n 



n{n — 1) • • • (n — A; + 1) 



J^J k\{n-k)\ 
Let a — X and 6=1; then 



A;! 



for 1 < k < n. 



k=l 



This result holds for some values of x even if the exponent n is not 
an integer, provided we allow the series to be an infinite series. 

We next prove this using Corollary 31.6. Our proof is motivated 
by that in [55]. 



31.7 Binomial Series Theorem. 

//« G R and \x\ < 1, then 



(1 + x)^ = 1 + 2^ ^ ^—^ ^-x^ 



(1) 



k=i 



Proof 

For k = 1,2,3,..., let ak = ^(^~^)"^(^~^+^) , If q/ is a nonnegative 
integer, then ak = 0 ioi k > a and (1) holds for all x as noted in 
our discussion prior to this theorem. Henceforth we assume a is not 
a nonnegative integer so that ak ^ 0 for all k. Since 

a — k 



lim 

k^oo 



dk 



lim 

k^oo 



k + l 
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the series in (1) has radius of convergence 1; see Theorem 23.1 and 
Corohary 12.3. Lemma 26.3 shows the series ^kakX^~^ also has 
radius of convergence 1, so it converges for \x\ < 1. Hence 



hm nanX^ ^ = 0 for \x\ < 1. 



(2) 



Let f{x) = (1 + x)^ for \x\ < 1. For n = 1, 2, . . ., we have 

= a{a-l)'"{a-n + 1)(1 + x)^"^ = n!a^(l + x)^"^. 

Thus /^^^(O) = n\an for ah n > 1, and the series in (1) is the Taylor 
series for /. 

For the remainder of this proof, x is a fixed number satisfying 
\x\ < 1. By Corollary 31.6, with c = 0, for each n, there is i/n 
between 0 and x such that 



So 



(n- 1)! 

\Rn{x)\ < \x\ 



(n- 1)! 



n-1 



n\an\{l + yn 



iCK— 1 



(3) 



We easily show that 
x-y 



l+y 



<\x\ if y is between 0 and x] 



indeed, note y — xz for some z G [0, 1], so 



x-y 




00 00 ^ 




1-z 


l + y 




1 + xz 


1 + xz 



< X 



since 1 + xz > 1 — z. Therefore, (3) implies 

\Rn{x)\ < \x\^n\an\{l+ynr-^. 

The sequence (1 + yn)^~^ is bounded, because the continuous func- 
tion ^ ^ (1 + y)^~^ is bounded on [— so from (2) and 
Exercise 8.4, we conclude lim^i?^(x) = 0, so that (1) holds. ■ 



We next give an example of a function / whose Taylor series ex- 
ists but does not represent the function. The function / is infinitely 
differentiable on R, i.e., derivatives of all order exist at all points 
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y 




H ! 1 1 1 

1 2 3 4 5 

/(x)=e- for;c>0 



X 



FIGURE 31.1 



of R. The example may appear artificial, but the existence of such 
functions [see also Exercise 31.4] is vital to the theory of distribu- 
tions, an important theory related to work in differential equations 
and Fourier analysis. 

Example 3 



Let f{x) = e -^/^ for X > 0 and f{x) = 0 for x < 0; see Fig. 31.1. 
Clearly / has derivatives of all orders at all x ^ 0. We will prove 



Hence the Taylor series for / is identically zero, so / does not agree 
with its Taylor series in any open interval containing 0. First we show 
for each n there is a polynomial Pn of degree 2n such that 



This is obvious for n = 0; simply set po{t) = 1 for all t. And this is 
easy for n = 1 and n = 2; the reader should check (2) holds with 
n = 1 and pi{t) = and (2) holds with n = 2 and p2{t) = - 2t^. 
To apply induction, we assume the result is true for n and write 

Pn{t) = ao + ait + a2t^ H + a2nt^^ where a2n / 0. 

Then for x > 0 we have 



/W(0) = 0 for n = 0,1,2,3,.... 



(1) 



= e-^/^'pnil/x) for X > 0. 



(2) 
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and a single differentiation yields 

2n 



-l/x 



kak_ 



k=l 



+ 



■ 2n 

E 

.k=0 



Ok 



-l/x , 



The assertion (2) is now clear for n + 1; in fact, the polynomial Pn^i 
is evidently 



2n 



Pi 



k=l 



2n 



J2^kt^ 



.k=0 



it'), 



which has degree 2n + 2. 

We next prove (1) by induction. Assume f^^\0) = 0 for some 
n > 0. We need to prove 

,_^/<")W-/<-)(0)^,.^^i 

x^O X — 0 x^O X 

Obviously lim^^^g- ^/^^H^) ^ 0 since f^^\x) = 0 for all x < 0. By 
Theorem 20.10 it suffices to verify 

lim =0. 

In view of (2), it suffices to show 

lim e-i/^g f-^ = 0 

x^0+ \X J 

for any polynomial q. In fact, since q{l/x) is a finite sum of terms of 
the form hk{l/x)^^ where /c > 0, it suffices to show 

lim f-^ e"^/^ = 0 for fixed A; > 0. 
x^0+ \x J 

As noted in Exercise 30.4, it suffices to show 

yk 



lim y^e ^ = lim — = 0, 



(3) 



and this can be verified via k applications of L'Hospital's Rule 30.2. 

□ 



As we observed in Remark 2.4 on page 12, Newton's method 
allows one to solve some equations of the form f{x) = 0. 
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FIGURE 31.2 
31.8 Newton's Method. 

Newton's method for finding an approximate solution to f{x) = 0 is 
to begin with a reasonable initial guess xq and then compute 



Xn — Xn-1 — r lOr n > 1. 



fix. 



n—1 ) 



Here Xn is chosen so that (x^,0) lies on the line through 
having slope f\xn-i)- See Fig. 31.2. Often the 
sequence (x^) converges rapidly to a solution of /(x) = 0. □ 



31.9 Secant Method. 

A similar approach to approximating solutions of f{x) =0 is to start 
with two reasonable guesses xq and xi and then compute 



Xn = Xn-1 77 r 77 ^ tor 71 > 2. 



Here x^ is chosen so that (x^,0) lies on the line through 
{xn-ij{xn-i)) and /(^n-2)). See Fig. 31.3. □ 
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FIGURE 31.3 secant method 



Example 4 

Consider the equation x^^ + x — 1 = 0. Let f{x) = x^^ + x — 1. 
The equation /(x) = 0 will have at least two solutions, because 
/(O) -1 and lim^^oo = limx^^oofix) +00. In fact, it 
has exactly two solutions, because f^{x) = lOx^ + 1 is 0 at only one 
point, y = — ^ —0.774, so that / decreases on (—00,7/) and 
increases on {y^oo). 

We will illustrate both approximation methods, starting with 
Newton's method. Since /(O) = —1 and /(I) = 1. a good initial 
guess for one of the solutions would be xq = 1. We omit the cal- 
culations, which we did on the spreadsheet Excel. With xq = 1 and 
Newton's method, we obtained xi ^ 0.909090909, X2 ^ 0.852873482, 
X3 ^ 0.836193375, X4 ^ 0.835083481 and x^ ^ 0.835079043. All sub- 
sequent approximations equaled xs's, so this is surely the value to 
9-place accuracy. 

Since /(—I) = —1, the other solution is less than —1, and 
since /(— 2) = 1,021, a good initial guess would be close to — 1. 
But we started at xq = —2 to see what happens. We obtained 
XI ^ -1.800546982, X2 ^ -1.621810423, X3 ^ -1.462802078, 
X4 ^ -1.324100397, X5 ^ -1.209349769, xq ^ -1.126853632, 
X7 ^ -1.085350048, xg ^ -1.076156798, xg ^ -1.075766739, and 
xio ^ —1.075766066. All further values of x^ approximated xio- Of 
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course, xq = —2 was a poor choice, and xq = —1.2 would have been 
more sensible. With this choice, x^ ^ —1.075766066. 

As we will see, with the secant method the convergence is a bit 
slower. To find the positive solution, we started with = 2 and 
xi = 1. We obtained xg ^ 0.835079043, so it took about twice as 
many iterations to get 9-place accuracy as with Newton's method. 
For the other solution, we started with xq = —2 and xi = — 1, and 
we obtained 9-place accuracy at — 1.075766066. If you look 

at a graph, you will see why choosing guesses on each side of the 
true solution can be efficient. If we had started with xq = —2 and 
xi = — 1.5, we would not have reach 9-place accuracy until x^. □ 

Unlike much of calculus, there isn't a single easily-found and 
easily-applied theorem justifying the use of either of these methods. 
We'll prove two such theorems, Theorems 31.12 and 31.13. They 
might be of value when studying the theory or when writing a pro- 
gram to implement a method. But for simple problems, it is much 
more efficient to simply assume and hope that the method will suc- 
ceed, and then use common sense to assess whether the method 
worked. 

The secant method predates Newton's method, but it does not 
seem as well known. In fact, the secant method is an example of 
the regula falsi (false position) method for approximating solutions 
of equations, which even appears in the Phind Papyrus attributed 
to the scribe Ahmes. It works in many examples, but a computer 
implementation would need to avoid a premature attempt to divide 
by 0. One advantage to this method is that the derivatives of / 
might be very complicated or not even exist. Another advantage to 
this method is that it can be used to find approximate solutions 
of equations, like cosx — x = 0, when studying functions in alge- 
bra or trigonometry. The methodology also might be useful when 
motivating the sequential definition of the derivative. 

We now work toward a theorem providing hypotheses that assure 
us that Newton's method works. We will need a technical lemma 
about sequences. 
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31.10 Lemma. 

Let (an) be a sequence of nonnegative numbers, and let C and 6 be 
positive numbers satisfying C6 < 1. 

(a) If ao < 6 and < Ca^_^ for n>l, then 

dn ^ {C5)^ ~^ci{) for all n > 0. 

(b) // max{ao, ai} < 6 and < Cmax{a^_i, a^_2}^ for n > 2, 
then 

max{a2n, tt2n+i} ^ (0(5)^''"''^ max{ao, ai} for all n > 0. 
Proof 

We prove (a) by mathematical induction, noting first that it is 
obvious for n = 0 and that ai < Ca^ < C6aQ. In general, if 
an < (C(5)^''~^ao, then 

an+i < Cal < C[{CSf^-^aof < C^^^'-^S^^^'-^Sao = {CSf^^'-^ao. 

For (b), we write M = max{ao, ai}, so that M < 6 and we need 
to show 

max{a2n, tt2n+l } < {C5f"-^M for all n > 0. 

This is trivial for n = 0. In general, if we have max{a2n) ci2n+i} < 
(C5)2"-iM, then 

02n+2 < Cmax{a2n+i,a2n}^ < C[iCSf"-^Mf 

= C2"+'-l52"+l-2^2 < ^2"+l-1^2"+l-2^^ ^ {C5f"^'-^M, 

and 

a2n+3 < Cmax{a2n+2, a2n+i}' < Cmax{(C5)2^^'-iM, (C(5)2^-1m}2 

Thus max{a2n+2 5 Q,2n+3} ^ (C5)^''^^~-'^M, and the induction proof 
of (b) is complete. ■ 
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31.11 Discussion. 

We assume / is defined and differentiable on an open interval J = 
(c, d). A glance at the definition 

_ f{Xn-l) 
Xji — Xfi—i , . 

!\Xn-\) 

suggests it is reasonable to assume is bounded away from 0 on J. 
This implies is always positive or always negative [Intermediate 
Value Theorem for Derivatives 29.8 on page 236]. Therefore / is 
strictly increasing or strictly decreasing on J, and / is one-to-one 
[Corollary 29.7]. In addition, we assume j" exists on J and \ is 
bounded above. 

Suppose there exists 5o > 0 with the property that /(x) =0 for 
some X in the closed interval / = [c + 5o, d — 5o] C J. We will show 
that if the initial value xq of Newton's sequence is sufficiently close 
to X, then the iterates x^ in Newton's method converge to x. To 
see how this goes, we assume for now that each Xn is indeed in the 
interval J. From the definition, we have 

j{Xn-\) f{Xn-l) ' {Xn-1 - x) - f{Xn-l) 



Xn X — Xji—\ 



f'{Xn-l) f'{Xn-l) 



By Taylor's Theorem 31.3 on page 250, with n = 2, c = Xn-i and 
X = X, we obtain 

0 = f{x) = f{Xn-l) + fXn-l) • {X - Xn-l) + ^fiVn) ' {x - Xn-lf 

for some between x^-i and x. Hence 

f{Xn-l) • {Xn-1 -X) - f{Xn-l) = ^fiVn) ' {x - Xn-lf, 



SO 



-_ fiVn) , __.2 

Xfi X — , . yXfi—1 X ) . 

2i\Xn-l) 



Therefore 



I -I ^ sup{|r(x)| :xG J} __2 
^' - 2inf{|/^(x)| :xG J}'^""' ^' ' 

so that 

I Xi n X I I X n — X X I 5 
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where C = 2M{frw^ ^^1^^^ 5 > 0 so that C6 < 1. By 

Lemma 31.10(a), with = \xn — we could conclude 

\xn — x\< {C6)'^''~^ \xo — x\ for all n > 0, (1) 

if we could arrange for \xq — x\ = < 6 . 

The inequalities (1) are our goal, and would assure us the 
sequence (xn) converges to x, but we need to backtrack and de- 
termine how to be sure each x^ is in the interval J, as well as 
arrange for \xq — x\ < 6. In addition to requiring C6 < 1, we 
will need to choose S so that 26 < Sq. Finally, we select xq in 
/ so that \f{xo)\ < mS where m = inf{|/'(x)| : x G J}. Note 
{xq — 2(5, Xq + 26) C (xo — Sq^xq + 6q) C J. We also have 

\xo — x| < (5, (2) 

because by the Mean Value Theorem 29.3, there is yo between xq 
and X such that 

, _ \f{xo)-f{x)\ _ \f{xo)\ ^ \f{xo)\ ^ , 

'° '~ l/'(yo)| ~l/'(yo)|- m 

By (1) and (2), for each n, we have \xn — x\ < \xo — x\ < 5; thus 
\xn — xo\ < \xn — x\ + \x — XQ\ < 2(5, SO that each is in the interval J. 
We summarize what we have. 



31.12 Theorem. 

Consider a function f having a zero x on an interval J = (c, d), and 
assume f" exists on J. Assume \f^^\ is bounded above on J and \f^\ 
is bounded away from 0 on J. Choose 60 > 0 so that I = [c + (5o, 
d — 60] C J is a nondegenerate interval containing x and so that 
[c + (5o, c? — 6()] C J. Let 



C = 



2inf{|/^(x)| : X G J}' 



and select 6 > 0 so that 26 < 60 and C6 < 1. Let m — inf{|/'(x)| : 
X G J}. Consider any xq in I satisfying |/(xo)| < m6. Then the 
sequence of iterates given by Newton^s method, 

Xn Xn-1 - -jr. r for n > 1, 

f {Xn-l) 
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is a well-defined sequence and converges to x. Also, 

\xn — ^1 ^ C\xn-i — for n > 1, and (1) 

\xn-x\<{C5f''~^\x^-x\ for n>0. (2) 

In view of (1), the convergence of (x^) is said to be "quadratic 
convergence." Here is an analogous theorem for the secant method. 
Comparing its conclusion with that in Theorem 31.12, it appears 
that it will take about twice as many iterations using the secant 
method to get the same accuracy as using Newton's method. This is 
what happened in Example 4 on page 260. 

31.13 Theorem. 

Notation and hypotheses are as in Theorem 31.12, except we set 

3sup{|r(x)|:xG J} 
2inf{|/^(x)| :xG J} ' 

and we consider distinct and xi in I satisfying 

max{|/(xo)|,|/(xi)|} < m6. (1) 

As before 6 > 0 is chosen so the 26 < 6o and C6 < 1. 

The sequence (xn) of iterates given by the secant method, 

f{Xn-l){Xn-2 - Xn-l) . /oA 
Xn = Xn-l 77 ^ 77 ^ for n > 2, (2) 

is well defined and converges to x. Also, 

\xn — x\<C- max{|x^_i — x|, \xn-2 — x\}^ for all n > 2, (3) 
and for n > 0, we have 

max{|x2n -^1, \x2n^i -x\} < {C6)'^''~^ max{|xo -x\, \xi -x\}. (4) 
Proof 

As in Discussion 31.11, (1) implies 

max{|xo — x\,\xi —x\} < 6. (5) 

Since 

___ f{Xn-l){Xn-2 - Xn-l) , 

Xfi X — Xn-l X \ r/ \ ^ :— ^1 

f[Xn-2) - f[Xn-l) 
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the Mean Value Theorem shows there is Wn between Xn-i and Xn-2 
so that 



___ f{Xn-l) 



f'iWn) 

By Taylor's Theorem 31.3 on page 250, with n = 2, c = x and 
X — Xji-i^ we have 

f{Xn-l) = f{x) + f{x) ' {Xn-1 - x) + ^fiVn) ' " 
= f{x) • {Xn-1 -X) + ^fiVn) • {Xn-1 xf 

for some yn between Xn-i and x. Hence 

fix) • {Xn-1 -X)+ fiVn) ■ {Xn-1 - xf 

Xn X-{Xn-l X) 

_ {Xn-\ - x)f'{Wn) - fjx) ■ [Xn-l - x) - fiVn) " [Xn-l - ^)^/2 
Xn-l - X /[^/(^^) _ _^/(-)] _ f"{yn) ■ {Xn-1 - x) 



f'iWn) ' ' ^' 2 

By the Mean Value Theorem, applied to we obtain 

Xn-X= —— — <^ / {Zn) • [Wn - X) } (6) 



for some Zn between and x. 

In general, a < c < b implies |c — x| < max{|a — x|, |6 — x|} for all 
X in R [Exercise 31.12]. Applying this, with a = min{x^_i, x^_2}, 
b = max{x^_i, x^_2}, c = Wn and x = x, we obtain 

\wn - ^1 < max{|x^_i - x|, \xn-2 - x\}. 

Using this and (6), above we conclude 

I _| ^ 3 8np{f\x) : X G J} __ __ 2 

\Xn X\ 2:^ , ^ , . ^ ^^ '^^'^\\Xji—l X\^ \Xji—2 X\j , 

2 mt|/'(x) : X e J\ 

so that (3) holds. Substituting = \xn — x\ into (3) and (5), we see 
that Lemma 31.10(b) implies the inequalities in (4). Inequalities (4) 
and (5) imply \xn — xq\ < 26 for all n, so each x^ is in J, as needed 
for the preceding argument. This completes the proof. ■ 
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Exercises 

31.1 Find the Taylor series for cosx and indicate why it converges to cosx 
for all X eR. 

31.2 Repeat Exercise 31.1 for the functions sinhx = ^(e^ — e~^) and 
coshx = |(e^ + e~^). 

31.3 In Example 2, why did we apply Theorem 31.3 instead of Corol- 
lary 31.4? 

31.4 Consider a, 6 in M where a < b. Show there exist infinitely dif- 
ferentiable functions /a, ^6, /ia,6 and /i* ^ on M with the following 
properties. You may assume, without proof, that the sum, product, 
etc. of infinitely differentiable functions is again infinitely differen- 
tiable. The same applies to the quotient provided the denominator 
never vanishes. 

(a) fa{x) = 0 for X < a and fa{x) > 0 for x > a. Hint: Let fa{x) = 
f{x — a) where / is the function in Example 3. 

(b) gb{x) = 0 for X > 6 and gb{x) > 0 for x < 6. 

(c) ha^b{x) > 0 for X G (a, b) and ha^hix) = 0 for x ^ (a, b). 

(d) hl^j^{x) = 0 for X < a and = 1 for x > 6. Hint: Use the 



31.5 Let g{x) = e-^/^' for x 7^ 0 and ^(0) = 0. 

(a) Show g^^'^O) = 0 for ah n = 0, 1, 2, 3, . . .. Hint: Use Example 3. 

(b) Show the Taylor series for g about 0 agrees with g only at x = 0. 

31.6 An older proof of Theorem 31.3 goes as follows, which we outline for 
c = 0. Assume x > 0, let M be as in the proof of Theorem 31.3, and 




let 




k=l 



for t in [0, x]. 

(a) Show F is differentiable on [0,x] and 



(n- 1)! 



M]. 
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(b) Show F(0) = F{x). 

(c) Apply Rolle's Theorem 29.2 to F to obtain y in (0, x) such that 
/(»)(y) = M. 

31.7 Show the sequence in Exercise 9.5 comes from Newton's method when 
solving f{x) = x^ — 2 = 0. 

31.8 (a) Show x^ -\- x^ — 1 = 0 has exactly two solutions. 

(b) Use Newton's method or the secant method to find the solutions 
to + — 1 = 0 to six-place accuracy. 

31.9 Exercise 18.6 asked for a proof that x = cosx for some x in (0, f ). 
Use Newton's method to find x to six-place accuracy. Hint: Apply 
Newton's method to f{x) = x — cosx. 

31.10 Exercise 18.7 asked for a proof that xe^ = 2 for some x in (0, 1). Use 
Newton's method to find x to six-place accuracy. 

31.11 Suppose / is differentiable on (a, 6), is bounded on (a, 6), never 
vanishes on (a, 6), and the sequence {xn) in (a, 6) converges to x in 
(a, b). Show that if 



Xn = Xn-1 - {[^"^ ^\ for all n > 1, 

then /(x) = 0. 

31.12 This result will complete the proof of Theorem 31.13. Show that if 
a < c < then |c — x| < max{|a — x\^\b — x\} for all x G M. Hint: 
Consider two casesi X < c and X > c. 
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CHAPTER 



This chapter serves two purposes. It contains a careful development 
of the Riemann integral, which is the integral studied in standard 
calculus courses. It also contains an introduction to a generalization 
of the Riemann integral called the Riemann-Stieltjes integral. The 
generalization is easy and natural. Moreover, the Riemann-Stieltjes 
integral is an important tool in probability and statistics, and other 
areas of mathematics. 

§32 The Riemann Integral 

The theory of the Riemann integral is no more difficult than several 
other topics dealt with in this book. The one drawback is that it 
involves some technical notation and terminology. 

32.1 Definition. 

Let / be a bounded function on a closed interval [a, b].^ For S C [a, 6], 
we adopt the notation 



^Here and elsewhere in this chapter, we assume a < b. 
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M(/, S) = sup{/(x) : X e S} and m(/, S) = inf{/(x) : x G 5}. 
A partition of [a, 6] is any finite ordered subset P having the form 

P = {a = to <ti < <tn = b}. 
The upper Darboux sum U{f, P) of / with respect to P is the sum 

n 

U{f,P) = J^M(/, [tk-utk]) • {tk-tk_,) 
k=i 

and the lower Darboux sum L{f, P) is 

n 

k=i 

Note 

n 

U{f, P)<Y1 M{f, [a, 6]) . (t, - = M(/, [a, 6]) • (6 - a); 

k=i 

hkewise L(/, P) > m(/, [a, 6]) • (6 — a), so 

m(/, [a, b]) ■{b-a)< L{f, P) < U{f, P) < M{f, [a, b]) ■ {b - a). (1) 
The upper Darboux integral U{f) of / over [a, b] is defined by 

[/(/) = inf {[/(/, P) : P is a partition of [a, 6]} 
and the /oi(;er Darboux integral is 

L(/) = sup{L(/, P) : P is a partition of [a, b]}. 
In view of (1), U{f) and are real numbers. 

We will prove in Theorem 32.4 that L(/) < [/(/). This is not 
obvious from (1). [Why?] We say / is integrable on [a, 6] provided 
L(/) = U{f). In this case, we write f or J^f{x)dx for this 
common value: 

/'/= f f{x)dx = L{f) = U{f). (2) 

Specialists call this integral the Darboux integral. Riemann's def- 
inition of the integral is a little different [Definition 32.8], but we will 
show in Theorem 32.9 that the definitions are equivalent. For this 




FIGURE 32.1 



reason, we will follow customary usage and call the integral defined 
above the Riemann integral. 

For nonnegative functions, f is interpreted as the area of the 
region under the graph of / [see Fig. 32.1] for the following reason. 
Each lower Darboux sum represents the area of a union of rectangles 
inside the region, and each upper Darboux sum represents the area of 
a union of rectangles that contains the region. Moreover, f is the 
unique number that is larger than or equal to all lower Darboux sums 
and smaller than or equal to all upper Darboux sums. Figure 19.2 
on page 145 illustrates the situation for [a, 6] = [0, 1] and 

n 1 2 n-1 ^ 
0 <-<-<••• < < 1 

n n n 



Example 1 

The simplest function whose integral is not obvious is f{x) = x^. 
Consider / on the interval [0, b] where 6 > 0. For a partition 

P = {0 = to<ti<" - <tn = b}, 

we have 



n n 

U{f,P) = J]sup{x2 : X G [tk-i,tk]}-{tk-tk-i) = ^tl{tk-tk-i). 
k=l k=l 
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If we choose tk = then we can use Exercise 1.1 to calculate 

n(n+ l)(2n + 1) 



k=i ^ ^ k=\ 



For large n, this is close to ^, so we conclude [/(/) < \. For the 
same partition we find 

{k-\f\? (h\ (n- l)(n)(2n- 1) 



I — 1 \ / 



rfi 6 



so L{f) > y. Therefore f{x) — is integrable on [0,6] and 

h ^3 

dx — — . 
3 

Of course, any calculus student could have calculated this inte- 
gral using a formula that is based on the Fundamental Theorem of 
Calculus; see Example 1 in §34. □ 

Example 2 

Consider the interval [a, 6], where a < b, and let f{x) = 1 for rational 
X in [a, 6], and let f{x) = 0 for irrational x in [a, b]. For any partition 

P = {a = to < h < ' " < tn = b}, 

we have 

n n 

U{f,P) = J2^(f^ [tk-utk])'{tk-tk-i) = Y,l'{tk-tk-i) = b-a 

k=l k=l 

and 



L{f.P)-^0'{tk-tk-i) = 0- 



k=i 



It follows that U{f) = b — a and L(/) = 0. The upper and lower 
Darboux integrals for / do not agree, so / is not integrable! □ 



We next develop some properties of the integral. 
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32.2 Lemma. 

Let f be a bounded function on [a, 6]. If P and Q are partitions of 
[a, b] and P ^ Q, then 

Lif, P) < Lif, Q) < U{f, Q) < Uif, P). (1) 

Proof 

The middle inequality is obvious. The proofs of the first and third 
inequalities are similar, so we will prove 

L{f,P)<L{f,Q). (2) 

An induction argument [Exercise 32.4] shows we may assume 
Q has only one more point, say than P. If 

P = {a = to < ti < " ' < tn = b}, 

then 

Q = {a = to < ti < ' ' ' < tk-i < u < tk < ' ' ' < tn = b} 

for some k G {1,2,. The lower Darboux sums for P and Q 
are the same except for the terms involving tk-i or tk- In fact, their 
difference is 

L{f, Q) - L{f, P) = m{f, [tfc-i, ii]) • {u - tk-i) + [u, t^]) • (tfc - u) 

-m{f, [tk-i,tk]) • {tk - tk-i). (3) 

To establish (2) it suffices to show this quantity is nonnegative. Using 
Exercise 4.7(a), we see 

m{f, [tk-i,tk]) ' {tk -tk-i) 

= ^(/, [tk-i.-tk]) • {{tk -u) + {u- tk-l)} 

< m{f, [u,tk]) ' {tk - u) +m{f, [tk-i,u]) • {u - tk-i). ^ 

32.3 Lemma. 

If f is a bounded function on [a^b], and if P and Q are partitions of 
[a,b], thenL{f,P)<U{f,Q). 

Proof 

The set P U Q is also a partition of [a, 6]. Since P C P \J Q and 
Q C P [J Q, we can apply Lemma 32.2 to obtain 

L{f, P) < L{f, P U Q) < U{f, PUQ)< U{f, Q). 
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32.4 Theorem. 

If f is a bounded function on [a,b], then L{f) < U{f). 
Proof 

Fix a partition P of [a, 6]. Lemma 32.3 shows L{f,P) is a lower 
bound for the set 

{[/(/, Q) : Q is a partition of [a, b]}. 

Therefore L(/, P) is less than or equal to the greatest lower bound 
[infimum!] of this set. That is 

L{f,P)<U{f). (1) 

Now (1) shows that U{f) is an upper bound for the set 

{L{f^P) : P is a partition of [a, 6]}, 

so [/(/) > L{f). m 

Note that Theorem 32.4 also follows from Lemma 32.3 and Ex- 
ercise 4.8; see Exercise 32.5. The next theorem gives a "Cauchy 
criterion" for integrability. 

32.5 Theorem. 

A bounded function f on [a, b] is integrable if and only if for each 
e > 0 there exists a partition P o/ [a, b] such that 

U{f,P)-L{f,P)<e. (1) 

Proof 

Suppose first that / is integrable and consider e > 0. There exist 
partitions Pi and P2 of [a, b] satisfying 

L{f,P,)>L{f)-'- and [/(/, P2) < f/(/) + i 

For P = Pi U P25 we apply Lemma 32.2 to obtain 
[/(/, P) - L{f, P) < U{f, P2) - L{f, Pi) 



e 



2 



<Uif) + -- L{f)-- =U{f)-L{f) + e 



2 



Since / is integrable, U{f) = L{f), so (1) holds. 
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Conversely, suppose for e > 0 the inequality (1) holds for some 
partition P. Then we have 

U{f) < U{f, P) = U{f, P) - L{f, P) + L(/, P) 
<e + L{f,P)<e + L{f). 

Since e is arbitrary, we conclude U{f) < L{f). Hence we have U{f) = 
L(/) by Theorem 32.4, i.e., / is integrable. ■ 

The remainder of this section is devoted to establishing the 
equivalence of Riemann's and Darboux's definitions of integrabil- 
ity. Subsequent sections will depend only on items Definition 32.1 
through Theorem 32.5. Therefore the reader who is content with the 
Darboux integral in Definition 32.1 can safely proceed directly to the 
next section. 

32.6 Definition. 

The mesh of a partition P is the maximum length of the subintervals 
comprising P. Thus if 

P = {a = to < h < " ' < tn = b}, 

then 

mesh(P) = mdix{tk — tk-i : = 1, 2, . . . , n}. 

Here is another "Cauchy criterion" for integrability. 

32.7 Theorem. 

A bounded function f on [a, b] is integrable if and only if for each 
6 > 0 there exists a 6 > 0 such that 

mesh(P) < S implies U{f, P) - L{f, P) < e (1) 

for all partitions P of [a, b]. 

Proof 

The e-6 condition in (1) implies integrability by Theorem 32.5. 

Conversely, suppose / is integrable on [a, b]. Let e > 0 and select 
a partition 

Po = {a = uo < ui < " ' < Um = b} 
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of [a, b] such that 

U{f,Po)-L{f,Po)<'-. (2) 

Since / is bounded, there exists B > 0 such that \f{x)\ < B for ah 
X G [a, b]. Let 6 = g^^; m is the number of intervals comprising Pq. 
To verify (1), we consider any partition 

P = {a = to < ti < • • • < = 6} 

with mesh(P) < 6. Let Q — P U Pq- If Q has one more element 
than P, then a glance at (3) in the proof of Lemma 32.2 leads us to 

L(/, Q) - L(/, P) <B- mesh(P) - (-P) • mesh(P) = 2P • mesh(P). 

Since Q has at most m elements that are not in P, an induction 
argument shows 

L(/, Q) - L{f, P) < 2mB • mesh(P) < 2mB5 = ^. 

By Lemma 32.2 we have L(/, Pq) < !/(/, Q), so 

L(/,Po)-L(/,P)<|. 

Similarly 

f/(/,P)-f/(/,Po)<|, 

so 

f/(/, P) - L{f, P) < U{f, Po) - L{f, Po) + |. 
Now (2) implies U{f, P) — L{f, P) < e and we have verified (1). ■ 

Now we give Riemann's definition of integrability. 
32.8 Definition. 

Let / be a bounded function on [a, 6], and let P = {a = to < ti < 
• • • < = 6} be a partition of [a, b]. A Riemann sum of / associated 
with the partition P is a sum of the form 

n 

- tk-i) 

k=i 
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where Xk G [tk-i,tk] for k = 1, 2, . . . , n. The choice of x^s is quite 
arbitrary, so there are infinitely many Riemann sums associated with 
a single function and partition. 

The function / is Riemann integrable on [a, b] if there exists a 
number r with the following property. For each e > 0 there exists 
6 > 0 such that 

\S-r\<e (1) 

for every Riemann sum S of f associated with a partition P having 
mesh(P) < 6. The number r is the Riemann integral of / on [a, b] 
and will be provisionally written as 7^ /a /• 

32.9 Theorem. 

A bounded function f on [a, b] is Riemann integrable if and only if 
it is [Darboux] integrable, in which case the values of the integrals 
agree. 

Proof 

Suppose first that / is [Darboux] integrable on [a, b] in the sense of 
Definition 32.1. Let e > 0, and let 5 > 0 be chosen so that (1) of 
Theorem 32.7 holds. We show 

<e (1) 
for every Riemann sum 

n 

S = ^f{xk){tk -tk-i) 
k=i 

associated with a partition P having mesh(P) < 5. Clearly we have 
L{f,P) < S < U{f,P), so (1) follows from the inequalities 

U{f,P)<Lif,P) + e<Lif) + e= f f + e 

J a 

and 



L{f,P)>U{f,P)-e>U{f)- 
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This proves (1); hence / is Riemann integrable and 

rh rb 

^ / / = / /• 

J a J a 

Now suppose / is Riemann integrable in the sense of Defini- 
tion 32.8, and consider e > 0. Let 6 > 0 and r be as given in 
Definition 32.8. Select any partition 

P = {a = to < ti < • • • < = 6} 

with mesh(P) < 5, and for each A; = 1, 2, . . . , n, select Xk in [tk-i,tk] 
so that 

f{xk) < m{f, [tk-i,tk]) + e. 
The Riemann sum S for this choice of x^s satisfies 

S <L{f, P) + e{b-a) 

as well as 

\S-r\< e. 

It follows that 

L{f) > L{f, P)>S-e{b-a)>r-e-e{b- a). 

Since e is arbitrary, we have L(f) > r. A similar argument shows 
U{f) < r. Since L(/) < U{f), we see L(/) = U{f) = r. This shows 
/ is [Darboux] integrable and 

/ f = r = n f. 

J a J a ^ 

32.10 Corollary. 

Let f be a bounded Riemann integrable function on [a, 6]. Suppose 
(Sn) is a sequence of Riemann sums, with corresponding partitions 
Pji, satisfying lim^mesh(P^) = 0. Then the sequence (Sn) converges 
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Proof 

Let e > 0. There is a 5 > 0 so that if 5 is a Riemann sum with 
corresponding partition P, and if mesh(P) < 5, then 

rb 

f <e. 

Choose N so that mesh(P^) < 6 for n > N. Then 

rb 



f 



< e for n > N. 



Since e > 0 is arbitrary, this shows hm^ Sn = f- 



32.11 Remark. 

I recently had occasion to use the fohowing simple observation. If 
one ignores the end intervals of the partitions, the "almost Riemann 
sums" so obtained still converge to the integral; see [59]. This arose 
because the intervals had the form [a, 6], but the partition points had 
the form ^. Thus the partition points were nice and equally spaced, 
except for the end ones. 



Exercises 

32.1 Find the upper and lower Darboux integrals for f{x) = on the 
interval [0,6]. Hint: Exercise 1.3 and Example 1 in §1 will be useful. 

32.2 Let f{x) = x for rational x and f{x) = 0 for irrational x. 

(a) Calculate the upper and lower Darboux integrals for / on the 
interval [0, 6]. 

(b) Is / integrable on [0,6]? 

32.3 Repeat Exercise 32.2 for g where g{x) = for rational x and 
g{x) = 0 for irrational x. 

32 A Supply the induction argument needed in the proof of Lemma 32.2. 

32.5 Use Exercise 4.8 to prove Theorem 32.4. Specify the sets S and T in 
this case. 
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32.6 Let / be a bounded function on [a, 6]. Suppose there exist sequences 
{Un) and {Ln) of upper and lower Darboux sums for / such that 
\im{Un — Ln) = 0. Show / is integrable and / = hm Un = hmL^. 

32.7 Let / be integrable on [a, 6], and suppose ^ is a function on [a, 6] 
such that g{x) = f{x) except for finitely many x in [a, 6]. Show g is 
integrable and / = g- Hint: First reduce to the case where / is 
the function identically equal to 0. 

32.8 Show that if / is integrable on [a, 6], then / is integrable on every 
interval [c, d] C [a, 6]. 



§33 Properties of the Riemann Integral 

In this section we establish some basic properties of the Riemann 
integral and we show many familiar functions, including piece- 
wise continuous and piecewise monotonic functions, are Riemann 
integrable. 

A function is monotonic on an interval if it is either increasing 
or decreasing on the interval; see Definition 29.6. 

33.1 Theorem. 

Every monotonic function f on [a, b] is integrable. 
Proof 

We assume / is increasing on [a, b] and leave the decreasing case to 
Exercise 33.1. We also assume /(a) < since otherwise / would 
be a constant function. Since /(a) < f{x) < f{b) for all x G [a, 6], 
/ is clearly bounded on [a, 6]. In order to apply Theorem 32.5, let 
e > 0 and select a partition P = {a = to < ti < • • • < = b} with 
mesh less than -mx^-rr^- Then 

n 

U(f, P) - L(f, P) = J2{M{f, [tk-i, tk]) - m(f, [U-i , tk])} ■ (tk - U-i) 

k=l 
n 

= - f{tk-i)] ■ {tk - tk-i). 

k=l 
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Since mesh(P) < jj^jzjj^^ we have 

n 

Theorem 32.5 now shows / is integrable. ■ 
33.2 Theorem. 

Every continuous function f on [a, b] is integrable. 
Proof 

Again, in order to apply Theorem 32.5, consider e > 0. Since / is 
uniformly continuous on [a, 6] by Theorem 19.2, there exists 6 > 0 
such that 

x,ye[a,b] and \x - y\ < S imply \f{x) - f{y)\ < (1) 

b — a 

Consider any partition P = {a = to < ti < • • • < = 6} where 

mdix{tk — tk-i : A; = 1, 2, . . . , n} < (5. 

Since / assumes its maximum and minimum on each interval 
[tk-i,tk] by Theorem 18.1, it follows from (1) above that 

[tk-utk])-m{f, [tk-utk]) < 

b — a 

for each k. Therefore we have 



U{f, P) - L{f, P) < V - tk-i) = e, 

and Theorem 32.5 shows / is integrable. ■ 
33.3 Theorem. 

Let f and g be integrable functions on [a^b], and let c be a real 
number. Then 

(i) of is integrable and cf = c f] 

(ii) f + g is integrable and J^{f + g) = f + g. 
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Exercise 33.8 shows fg, max(/, ^) and min(/, ^) are also inte- 
grable, but there are no formulas giving their integrals in terms of 
/a/andX,%. 

Proof 

The proof of (i) involves three cases: c > 0, c = — 1, and c < 0. Of 
course, (i) is obvious for c = 0. 

Let c > 0 and consider a partition 

P = {a = to < ti < ' " < tn = b} 

of [a, 6]. A simple exercise [Exercise 33.2] shows 

M(c/, [tk-i,tk]) = c-M{f, [tk-i,tk]) 

for all A;, so U{cf^P) = c • U{f,P). Another application of the 
same exercise shows U{cf) = c • U{f). Similar arguments show 
L(c/) = c ' L{f). Since / is integrable, we have L{cf) = c- L{f) = c- 
U{f) = U{cf). Hence cf is integrable and 

\f = U{cf) = c-U{f) = cff, c>0. (1) 

J a 

Now we deal with the case c = —1. Exercise 5.4 implies 
U{—f, P) — —L{f, P) for all partitions P of [a, h]. Hence we have 

[/(-/) = inf {[/(-/, P) : P is a partition of [a, h]} 
= inf{— L(/, P) : P is a partition of [a, h]} 
= — sup{L(/, P) : P is a partition of [a, 6]} = —L{f). 

Replacing / by — /, we also obtain L{—f) = —U{f). Since / is inte- 
grable, U{—f) = —L{f) = —U{f) = L{—f)] hence — / is integrable 
and 




The case c < 0 is handled by applying (2), and then (1) to — c: 

rb rb rb rb 

/ cf = - i-c)f = -i-c) / f = c f. 

J a J a J a J a 



/ 
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To prove (ii) we will again use Theorem 32.5. Let e > 0. By 
Theorem 32.5 there exist partitions Pi and P2 of [a, 6] such that 

Uif,Pi)-Lif,Pi)<^ and Uig,P2)-Lig,P2)<^. 

Lemma 32.2 shows that if P = Pi U P25 then 

U{f,P)-L{f,P)<^ and U{g,P)-Lig,P)<^. (3) 

For any subset S of [a, 6], we have 

inf{/(x) + g{x) : x e S} > inf{/(x) : x G 5} + inf{^(x) : x G 5}, 
i.e., m(/ + g^S) > m{f, S) + m(^, S). It follows that 

L{f + g,P)>L{f,P) + L{g,P) 
and similarly we have 

U{f + g,P)<U{f,P) + U{g,P). 
Therefore from (3) we obtain 

U{f + g,P)-L{f + g,P)<e. 
Theorem 32.5 now shows / + ^ is integrable. Since 

/'(/ + 9) = U{f + g)< U{f + g,P)< U{f, P) + U{g, P) 

J a 

<L{f,P)+L{g,P) + e<L{f)+L{g) + e= f f+ fg + e 

and 

[\f + g)= L{f + g)> L{f + g,P)> L{f, P) + L{g, P) 

J a 

>U{f,P) + U{g,P)-e>U{f) + U{g)-e= f f+ f g - e, 
we see that 



rb rb rb 

J a J a J a 
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33.4 Theorem. 

(i) /// and g are integrable on [a, 6] and if f{x) < g{x) for x in 
[a,h], then f < J^g. 

(ii) If g is a continuous nonnegative function on [a, b] and if 

g = 0; then g is identically 0 on [a, 6]. 

Proof 

(i) By Theorem 33.3, h = g — f is integrable on [a, 6]. Since 
h{x) > 0 for all x G [a, 6], it is clear that L{h,P) > 0 for 
all partitions P of [a, 6], so h = L{h) > 0. Applying 
Theorem 33.3 again, we see 

b rb rb rb 

9= f+ h > f. 



(ii) Otherwise, since g is continuous, there is a nonempty interval 
(c, d) C [a,b] and a > 0 satisfying g(x) > a/2 for x G (c, d). 
Then 

^ 5> f(d-c) >0, 

contradicting 9 = 0- ■ 
33.5 Theorem. 

/// is integrable on [a,b], then \ f\ is integrable on [a,b] and 



b 



f 



a 



b 



< I/I- (1) 



a 



Proof 

This follows easily from Theorem 33. 4 (i) provided we know |/| is 
integrable on [a, 6]. In fact, — 1/| < / < |/|; therefore 

rb rb 



rb rb rb 

- \f\< /< / I/I, 

J a J a J a 



which implies (1). 

We now show |/| is integrable, a point that was conveniently 
glossed over in Exercise 25.1. For any subset S of [a, 6], we have 

M(|/|, S) - m{\f\,S) < M{f, S) - m{f, S) (2) 
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by Exercise 33.6. From (2) it follows that 

U{\flP) - L(|/|,P) < U{f,P)-L{f,P) (3) 

for all partitions P of [a, 6]. By Theorem 32.5, for each 6 > 0 there 
exists a partition P such that 

C/(/,P)-L(/,P)<e. 

In view of (3), the same remark applies to |/|, so |/| is integrable by 
Theorem 32.5. ■ 

33.6 Theorem. 

Let f be a function defined on [a,b]. If a < c < b and f is integrable 
on [a,c] and on [c^b], then f is integrable on [a, 6] and 

rc rb 

f+ /• (1) 

J a J a J c 

Proof 

Since / is bounded on both [a, c] and [c, 6], / is bounded on [a, b]. In 
this proof we will decorate upper and lower sums so that it will be 
clear which intervals we are dealing with. Let e > 0. By Theorem 32.5 
there exist partitions Pi and P2 of [a, c] and [c, b] such that 

C/,-(/,Pi)-L^(/,Pi)<| and C/,^(/,P2)-L^(/,P2)<|. 

The set P = Pi U P2 is a partition of [a, 6], and it is obvious that 

u'M,P)-Kif,Pi) + u!{f,P2) (2) 

with a similar identity for lower sums. It follows that 

U'M,P)-Ll{f,P)<e, 
SO / is integrable on [a, 6] by Theorem 32.5. Also (1) holds because 

r / < u'M, P) = u'aif, Pi) + u'M, P2) 

J a 

<Ll{f,Pr) + Ll{f,P2) + e< f f+ f f + e 

J a J c 

and similarly f > Ja f + Jc f - ^- ■ 
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Most functions encountered in calculus and analysis are covered 
by the next definition. However, see Exercises 33.10-33.12. 

33.7 Definition. 

A function / on [a, b] is piecewise monotonic if there is a partition 

P = {a = to < ti < " ' < tn = b} 

of [a, 6] such that / is monotonic on each interval (tk-i^tk)- The 
function / is piecewise continuous if there is a partition P of [a, b] 
such that / is uniformly continuous on each interval {tk-i^tk). 

33.8 Theorem. 

If f is a piecewise continuous function or a bounded piecewise 
monotonic function on [a^b], then f is integmble on [a, 6]. 

Proof 

Let P be the partition described in Definition 33.7. Consider a fixed 
interval [tk-i^tk]. If / is piecewise continuous, then its restriction to 
(tk-i^tk) can be extended to a continuous function fk on [tk-i^tk] 
by Theorem 19.5. If / is piecewise monotonic, then its restriction to 
{tk-i,tk) can be extended to a monotonic function f^ on [tk-i^tk]] 
for example, if / is increasing on (tk-i^tk)^ simply define 

fk{tk) = sup{/(x) : X G (tk-i^tk)} 

and 

fk{tk-i) = inf{/(x) : X G {tk-i,tk)}. 

In either case, fk is integrable on [tk-i,tk] by Theorem 33.1 or 33.2. 
Since / agrees with fk on [tk-i^tk] except possibly at the endpoints. 
Exercise 32.7 shows / is also integrable on [tk-i^tk]- Now Theo- 
rem 33.6 and a trivial induction argument show / is integrable on 
[a,b]. U 

We close this section with a simple but useful result. 
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33.9 Intermediate Value Theorem for Integrals. 

/// is a continuous function on [a, b], then for at least one x in (a, h) 
we have 




Proof 

Let M and m be the maximum and minimum values of / on [a, h]. 
li m = M, then / is a constant function and f{x) = / for 

all X G [a, 6]. Otherwise, m < M and by Theorem 18.1, there exist 
distinct xq and yo in [a, b] satisfying /(xq) = m and f{yo) = M. Since 
each function M — f and / — m is nonnegative and not identically 0, 
Theorem 33.4(ii) shows J^m < f < J^M. Thus 

1 

m < / / < M, 

and by the Intermediate Value Theorem 18.2 for continuous func- 
tions, we have f{x) — f for some x between xq and yo. Since 
X is in (a, 6), this completes the proof. ■ 



33.10 Discussion. 

An important question concerns when one can interchange limits and 
integrals, i.e., when is 

rb rb 

lim / fn{x)dx^ I fn{x)dx (1) 

true? By Theorems 24.3 and 25.2, if the /^s are continuous and 
converge uniformly to f = lim^^oo fn on. [a, 6], then / is continuous 
and (1) holds. It turns out that if each is just Riemann integrable 
and fn^f uniformly, then / is Riemann integrable and (1) holds; 
see Exercise 33.9. What happens ii fn ^ f pointwise on [a, 6]? One 
problem is that / need not be integrable even if it is bounded and 
each fn is integrable. 

Consider, for example, the non-integrable function / in Exam- 
ple 2 on page 272: f{x) = 1 for rational x in [a, b] and f{x) = 0 for 
irrational x in [a, 6]. Let {xk)keN be an enumeration of the rationals 
in [a, 6], and define fn{xk) = 1 for 1 < A; < n and fn{x) = 0 for 
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all other x in [a, b]. Then fn^f pointwise on [a, 6], and each is 
integrable. 

This example leaves open the possibility that (1) will hold pro- 
vided all the functions fn and the limit function / are integrable. 
However, Exercise 33.15 provides an example of a sequence (/^) of 
functions on [0, 1] converging pointwise to a function /, with all the 
functions integrable, and yet (1) does not hold. Nevertheless, there 
is an important theorem that does apply to sequences of functions 
that converge pointwise. □ 

33.11 Dominated Convergence Theorem. 

Suppose (fn) is a sequence of integrable functions on [a, b] and fn 
f pointwise where f is an integrable function on [a, 6]. If there exists 
an M > 0 such that \fn{x)\ < M for all n and all x in [a, b], then 



We omit the proof. An elementary proof of the Dominated Con- 
vergence Theorem is given by Jonathan W. Lewin [42]. Here is a 
corollary. 

33.12 Monotone Convergence Theorem. 

Suppose (fn) is a sequence of integrable functions on [a, b] such that 
fi{x) < f2{x) < ••• for all X in [a, 6]. Suppose also that fn ^ f 
pointwise where f is an integrable function on [a, 6]. Then 



This follows from the Dominated Convergence Theorem, because 
there exists an M > 0 such that \fi{x)\ < M and also \f{x)\ < M 
for all X in [a, b]. This implies \fn{x)\ < M for all n and all x in [a, 6], 
since -M < fi{x) < fn{x) < M for ah x. 

Our version of the Dominated Convergence Theorem is a spe- 
cial case of a much more general theorem, which is usually stated 
and proved for the family of all "Lebesgue integrable functions," 
not just for Riemann integrable functions. There is also a Monotone 
Convergence Theorem for Lebesgue integrable functions, but in that 
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generality it does not follow immediately from the Dominated Con- 
vergence Theorem, because in that setting integrable functions need 
not be bounded. An elementary proof of the Monotone Convergence 
Theorem is proved for Riemann integrable functions, without resort 
to Lebesgue theory, by Brian S. Thomson [67]. 



Exercises 

33.1 Complete the proof of Theorem 33.1 by showing that a decreasing 
function on [a, b] is integrable. 

33.2 This exercise could have appeared just as easily in §4. Let 5 be a 
nonempty bounded subset of M. For fixed c > 0, let cS = {cs : s G S}. 
Show sup(c5') = c • sup(5') and inf(c5') = c • inf(S'). 

33.3 A function / on [a, b] is called a step function if there exists a partition 
P = {a = uo < ui < ■ ■ ■ < Cm = b} of [a^b] such that / is constant 
on each interval (uj-i^Uj), say f{x) = Cj for x in (uj-i^Uj). 

(a) Show that a step function / is integrable and evaluate f. 

(b) Evaluate the integral P{x) dx for the postage-stamp function 
P in Exercise 17.16. 

33.4 Give an example of a function / on [0, 1] that is not integrable for 
which I/I is integrable. Hint: Modify Example 2 in §32. 

33.5 Show |/'2^x2sin^(e^)dx| < 

33.6 Prove (2) in the proof of Theorem 33.5. Hint: For xq, ^ 5', we have 
\f{xo)\ - |/(yo)| < |/(a^o) - /(yo)| < S) - mif, S). 

33.7 Let / be a bounded function on [a, 6], so that there exists B > 0 such 
that \f{x)\ < B for ah x G [a,b\. 

(a) Show 

U{f\P) - L{f, P) < 2B[Uif, P) - L{f, P)] 

for all partitions P of [a, h\. Hint: f{xY — fiy)"^ = [f{x) + f(y)] ■ 
[f{x)-f{y)]. 

(b) Show that if / is integrable on [a, 6], then also is integrable 
on [a, b]. 
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33.8 Let / and g be integrable functions on [a, b]. 

(a) Show fg is integrable on [a, b]. Hint: Use Exercise 33.7 and 4/^ = 

(/ + <?)'-(/-#• 

(b) Show max(/, ^) and mm{f,g) are integrable on [a, 6]. Hint: 
Exercise 17.8. 

33.9 Let (fn) be a sequence of integrable functions on [a, 6], and suppose 
fn^f uniformly on [a, 6]. Prove / is integrable and 

/ /= lim / /„. 

Compare this result with Theorems 25.2 and 33.11. 

33.10 Let f{x) = sin ^ for x 7^ 0 and /(O) = 0. Show / is integrable on 
[—1, 1]. Hint: See the answer to Exercise 33.11(c). 

33.11 Let f{x) = X sgn(sin ^) for x 7^ 0 and /(O) = 0. 

(a) Show / is not piecewise continuous on [—1,1]. 

(b) Show / is not piecewise monotonic on [—1, 1]. 

(c) Show / is integrable on [—1,1]. 

33.12 Let / be the function described in Exercise 17.14. 

(a) Show / is not piecewise continuous or piecewise monotonic on 
any interval [a, 6]. 

(b) Show / is integrable on every interval [a, b] and / = 0. 

33.13 Suppose / and g are continuous functions on [a, 6] such that / = 
j^g. Prove there exists x in (a, b) such that f{x) = g{x). 

33.14 (a) Prove the following generalization of the Intermediate Value The- 

orem for Integrals. If / and g are continuous functions on [a, b] 
and g{t) > 0 for all t G [a, 6], then there exists x in (a, 6) such 
that 




f{t)g{t)dt = f{x) / g{t)dt. 



(b) Show Theorem 33.9 is a special case of part (a). 

(c) Does the conclusion in part (a) hold if [a, b] = [—1,1] and f{t) = 
g(t)=t for ah tl 
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33.15 For integers n > 3, define the function fn on [0, 1] by the rules: 



§34 Fundamental Theorem of Calculus 

There are two versions of the Fundamental Theorem of Calculus. 
Each says, roughly speaking, that differentiation and integration are 
inverse operations. In fact, our first version [Theorem 34.1] says "the 
integral of the derivative of a function is given by the function," 
and our second version [Theorem 34.3] says "the derivative of the 
integral of a continuous function is the function." It is somewhat 
traditional for books to prove our second version first and use it to 
prove our first version, although some books do avoid this approach. 
F. Cunningham, Jr. [18] offers some good reasons for avoiding the 
traditional approach: 

(a) Theorem 34.3 implies Theorem 34.1 only for functions g whose 
derivative is continuous; see Exercise 34.1. 

(b) Making Theorem 34.1 depend on Theorem 34.3 obscures the 
fact that the two theorems say different things, have different 
applications, and may leave the impression Theorem 34.3 is the 
fundamental theorem. 

(c) The need for Theorem 34.1 in calculus is immediate and easily 
motivated. 




and 





the Dominated Convergence Theorem? 



In what follows, we say a function h defined on (a, b) is integrable 
on [a, b] if every extension of h to [a, b] is integrable. In view of 
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Exercise 32.7, the value h will not depend on the values of the 
extensions at a or 6. 



34.1 Fundamental Theorem of Calculus I. 

If g is a continuous function on [a, 6] that is differentiable on (a^b), 
and if g' is integrable on [a^b], then 

rb 

(1) 



/ 9 = 9{b) - g{a). 

J a 



Proof 

Let e > 0. By Theorem 32.5, there exists a partition P = {a = to < 
ti < ' ' ' < tji = b} of [a, b] such that 



Uig',P)-Lig',P)<e. 



(2) 



We apply the Mean Value Theorem 29.3 to each interval [tk-i,tk] to 
obtain in (t^-i^tk) for which 

{tk - tk-i)9{xk) = g{tk) - 9{tk-i)' 

Hence we have 

n n 

g{b) -g{a) = ^[g{tk) - g{tk-i)] = '^9'{xk){tk -tk-i)- 

k=l k=l 

It follows that 

L{g',P)<gib)-g{a)<U{g',Py, (3) 
see Definition 32.1. Since 

L{g',P)< fg'<U{g',P), 

J a 

inequalities (2) and (3) imply 

- [gib) - gia)] <e. 
Since e is arbitary, (1) holds. ■ 



The integration formulas in calculus all rely in the end on 
Theorem 34.1. 
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Example 1 

If g{x) = then g^{x) = x"^, so 



b ^n+l _ 

x'^dx = = . (1) 

n+ln+1 n+1 



In particular, 

,3 



X dx 



a 



n+l 

Formula (1) is valid for any powers n for which g{x) = is 
defined on [a, 6]. See Examples 3 and 4 in §28 and Exercises 29.15 
and 37.5. For example, 

/ ^dx= [ x^l^ dx - c?l^\ for 0<a<6. 



34.2 Theorem [Integration by Parts]. 

// u and V are continuous functions on [a, 6] that are differentiable 
on {a^h), and if u' and v' are integrable on [a,b], then 

rb 

u{x)v{x) dx + u{x)v{x) dx = u{b)v{b) — u{a)v{a). (1) 



Proof 

Let g = uv; then g' = uv' ^u'v by Theorem 28.3. Exercise 33.8 shows 
g' is integrable. Now Theorem 34.1 shows 

rb 

g\x) dx — g{b) — g{a) = u{b)v{b) — u{a)v{a)^ 
so (1) holds. ■ 

Note the use of Exercise 33.8 above can be avoided if u' and v' 
are continuous, which is normally the case. 



Example 2 

Here is a simple application of integration by parts. To calculate 
XC08X dx, we note the integrand has the form u{x)v^{x) where 
u{x) = X and v{x) = sinx. Hence 
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/ xcosx dx = u{it)v{ii) — u{{))v{{))— I 
Jo Jo 



l-smxdx = — I smxdx = —2. 

□ 



0 



In what follows we use the convention f — ~ ft f cl > b. 

34.3 Fundamental Theorem of Calculus II. 

Let f be an integrable function on [a, 6]. For x in [a^b], let 



F{x)= r f{t)dt. 

J a 



Then F is continuous on [a, 6]. /// is continuous at in (a, b), then 
F is differentiable at and 

F\xo) = f{xo). 

Proof 

Select 5 > 0 so that \f{x)\ < B for all x G [a, 6]. If x,^ G [a, 6] and 
\x — y\ < where x < y, say, then 



\F{y)-F{x)\ = 



ry ry py 

/ f{t)dt < \f{t)\dt< Bdt^B{y-x) <e. 

J X J X J X 



This shows F is [uniformly] continuous on [a, 6]. 
Suppose / is continuous at xq in (a, 6). Observe 



F{x) - F(xo) 1 



X 0 0 

for X ^ xq. The trick is to observe 



X 



fit) dt 

XQ 



/(xo) = — ^ r f{xo)dt 



and therefore 

F{x) - f{xo) 



- f{xo) = Hfit) - fixo)] dt. (1) 

00 00 Q 00 00 Q ^ xq 

Let e > 0. Since / is continuous at xq, there exists 5 > 0 such that 
t G (a, 6) and \t — xq] < 6 imply — /(xo)| < e; 
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see Theorem 17.2. It follows from (1) that 



< e 

X — Xq 

for X in (a, 6) satisfying \x — xq\ < 6] the cases x > xq and x < xq 
require separate arguments. We have just shown 

hm /(xo). 

x^XQ X — Xq 

In other words, F\xo) = f{xo). ■ 

A useful technique of integration is known as "substitution." A 
more accurate description of the process is "change of variable." The 
technique is the reverse of the chain rule. 

34.4 Theorem [Change of Variable]. 

Let u be a differentiable function on an open interval J such that 
is continuous, and let I he an open interval such that u{x) G / for 
all X ^ J. If f is continuous on I, then f ou is continuous on J and 

b p'^i^) 

f o u{x)u {x) dx — / f{u)du (1) 

J u(a) 

for a, b in J. 

Note u{a) need not be less than u{b)^ even if a < 6. 
Proof 

The continuity of f ou follows from Theorem 17.5. Fix c in / and let 
F{u) = f{t) dt. Then F\u) = f{u) for all G / by Theorem 34.3. 
Let g — F o u. By the Chain Rule 28.4, we have 

g\x) — F\u{x)) ' u'{x) = f{u{x)) • u'{x)^ 

so by Theorem 34.1 

ph rb 

/ / o u{x)u{x) dx = dx — g{b) — g{a) = F{u{b)) — F{u{a)) 

J a J a 

ru{h) ru(a) f^i^) 

= / fit)dt- / fit)dt= / f{t)dt. 

Jc Jc J u(a) 



This proves (1). 
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Example 3 

Let ^ be a one-to-one differentiable function on an open interval /. 
Then J = g{I) is an open interval, and the inverse function is 
differentiable on J by Theorem 29.9. We show 

h ngih) 

g{x) dx+ g {u)du^h- g{h) - a • g{a) (1) 

Jg{a) 

for a, h in /. 

We put / = g~^ and u = g in the change of variable formula to 
obtain 

nh rg(b) 

/ g o g(^x)g\x) dx = / g {u)du. 
Since g~^ o g[x) — x ioi x in /, we obtain 

rg{h) rb 



pg[0) nb 

I g~ {u)du= I xg\x)dx. 

J oia) J a 



Now integrate by parts with u{x) — x and v{x) — g{x): 

■g{h) rb 

g {u)du — h • g{h) — a • g{a) — I g{x) dx. 

g{a) J a 

This is formula (1). □ 



Exercises 

34.1 Use Theorem 34.3 to prove Theorem 34.1 for the case is continuous. 
Hint: Let F{x) = j^g'] then F' = g' . Apply Corollary 29.5. 

34.2 Calculate 

(a) lima^^o ^ Jo" e^' dt (b) lim/,^o \ J^^^ e^' dt. 

34.3 Let / be defined as follows: f{t) = 0 for t < 0; f{t) = t for 0 < t < 1; 
f{t) = 4 for t > 1. 

(a) Determine the function F{x) = f{t) dt. 

(b) Sketch F. Where is F continuous? 

(c) Where is F differentiable? Calculate F' at the points of 
differentiability. 
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34.4 Repeat Exercise 34.3 for / where f{t) = t for t < 0; f{t) = + 1 for 
0 < t < 2; f{t) = 0 for t > 2. 

34.5 Let / be a continuous function on R and define 

F{x) = / f{t) dt for X eR. 

Jx-l 

Show F is differentiable on R and compute F\ 

34.6 Let / be a continuous function on R and define 

nsin X 

G{x) = / f{t) dt for xeR. 
Jo 

Show G is differentiable on R and compute G^ 

34.7 Use change of variables to integrate x^J\ — x'^ dx. 

34.8 (a) Use integration by parts to evaluate 

X diTctdin X dx . 
Hint: Let u{x) = arctanx, so that u\x) = j^^- 

2 

(b) If you used v{x) = ^ in part (a), do the computation again 

with v{x) = ^ 2^"*- . This interesting example is taken from J.L. 
Borman [10]. 

34.9 Use Example 3 to show J^^^^ arcsinxdx = + ^ — 1- 

34.10 Let ^ be a strictly increasing continuous function mapping [0, 1] onto 
[0, 1] . Give a geometric argument showing g{x)dx^ Io9~^ {u)du = 1. 

34.11 Suppose / is a continuous function on [a, h]. Show that if y f{xfdx 
= 0, then fix) = 0 for all x in [a, h]. Hint: See Theorem 33.4. 

34.12 Show that if / is a continuous real- valued function on [a, h] satisfying 
ja f{x)g{x) dx = 0 for every continuous function g on [a, 6], then 
f {x) = 0 for all X in [a, b]. 
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§35 * Riemann-Stieltjes Integrals 

In this long section we introduce a useful generalization of the Rie- 
mann integral. In the Riemann integral, all intervals of the same 
length are given the same weight. For example, in our definition of 
upper sums 

n 

U{f,P) = 5^M(/, [tk-utk]) • (t, - (*) 
k=i 

the factors {t^ — tk-i) are the lengths of the intervals involved. In 
applications such as probability and statistics, it is desirable to mod- 
ify the definition so as to weight the intervals according to some 
increasing function F. In other words, the idea is to replace the fac- 
tors {tk —tk-i) in (*) by [F{tk) — F{tk-i)]' The Riemann integral is, 
then, the special case where F{t) = t for all t. 

It is also desirable to allow some points to have positive weight. 
This corresponds to the situation where F has jumps, i.e., where 
the left-hand and right-hand limits of F differ. In fact, if (ck) is a 
sequence in R, then the sums 

oo 
k=l 

can be viewed as a generalized integral for a suitable F [see Exam- 
ples 1 and 3 on pages 301 and 309]. In this case, F has a jump at 
each Uk- 

The traditional treatment, in all books that I am aware of, re- 
places the factors {tk — tk-i) in (*) by [F{tk) — F{tk-i)\ and develops 
the theory from there, though some authors emphasize upper and 
lower sums while others stress generalized Riemann sums. In this 
section, we offer a slightly different treatment, so 

Warning. Theorems in this section do not necessarily correspond to 
theorems in other texts. 

We deviate from tradition because: 

(a) Our treatment is more general. Functions that are Riemann- 
Stieltjes integrable in the traditional sense are integrable in our 
sense [Theorem 35.20]. 
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(b) In the traditional theory, if / and F have a common discontinu- 
ity, then / is not integrable using F. Such unfortunate results 
disappear in our approach. We will show piecewise continu- 
ous and piecewise monotonic functions are always integrable 
using F [Theorem 35.17]. We also will observe that if F is a 
step function, then all bounded functions are integrable; see 
Example 1. 

(c) We will give a definition involving Riemann-Stieltjes sums that 
is equivalent to our definition involving upper and lower sums 
[Theorem 35.25]. The corresponding standard definitions are 
not equivalent. 

As just explained, our development of Riemann-Stieltjes integrals 
has several positive features. However, this section is long with lots of 
technical details. Therefore, we recommend readers omit the proofs 
on first reading, and then decide whether to go through the details. 

Many of the results in this section are straightforward general- 
izations of results in §§32 and 33. Accordingly, many proofs will be 
brief or omitted. 

35.1 Notation. 

We assume throughout this section that F is an increasing function 
on a closed interval [a, 6]. To avoid trivialities we assume F{a) < 
F{b). All left-hand and right-hand limits exist; see Definition 20.3 
and Exercise 35.1. We use the notation 

F{t~) = lim F{x) and = lim F{x). 

x^t- x^t+ 

For the endpoints we decree 

F(a-) = F{a) and = F{h). 

Note that F{t~) < F{t^) for all t G [a, 6]. If F is continuous at t, then 
F{t-) = F{t) = Otherwise F{t-) < and the difference 

- F{t~) is called the jump of F at t. The actual value of F{t) 
at jumps t will play no role in what follows. □ 

In the next definition we employ some of the notation established 
in Definition 32.1. 
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35.2 Definition. 

For a bounded function / on [a, b] and a partition P = {a = to < 
ti < ' ' ' < tn = b} oi [a, 6], we write 

n 

Mf, p)^Yl /(*^) • [^(4) - nt^)]- (1) 

k=0 

The upper Darboux-Stieltjes sum is 

n 

k=i 

and the lower Darboux-Stieltjes sum is 

L^(/,P) = J,.(/,P) + J^m(/,(t,_i,t,)) . [F(t-) (3) 

k=i 

These definitions exphcitly take into account the possible jump 
effects of F at the points tk, though F may have jumps at other 
points. The other terms focus on the effect of F on the open intervals 
{tk-i,tk)- Observe 

n n 
k=0 k=l 

represents [a, b] as a disjoint union. ^ See Remarks 35.26 for a discus- 
sion about the choice of open intervals versus closed intervals in the 
definitions of Riemann integrals and Riemann-Stieltjes integrals. 
Note 

UF{f,P)-LF{f,P) 

n 

= J^[M(/,(t,_i,t,)) -m(/,(t,_i,t,))][F(t-) - 
k=i 

and 

m(/, [a,b]) ■ [F{b) - F{a)] < Lpif^P) < UfU.P) 

<M(/,[a,5])-[F(6)-F(a)]. (5) 



^In measure theory this is an example of a measurable partition, that is to say, 
a family of measurable sets with disjoint union [a, 6]. 
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In checking (5), note 

n n 

k=o k=i (6) 

= F{4) - F(to-) + ELi[^(4) - ntti)] 

= F(a+) - F(a-) + - F(a+) = F{b) - F(a), 

since the last sum is a telescoping sum. The upper Darboux-Stieltjes 
integral is 

UF{f) = mfiUrif, P) : P is a partition of [a, b]} (7) 

and the lower Darboux-Stieltjes integral is 

Lrif) — sup{Li?(/, P) : P is a partition of [a, 6]}. (8) 

Theorem 35.5 below states that Lp^f) < Accordingly, we 

say / is Darboux-Stieltjes integrable on [a, b] with respect to F or, 
more briefly, F-integrable on [a, 6], provided Lp^f) — UF{f)] in this 
case we write 

h rh 

fdF= / f{x)dF{x)^LF{f)^UF{f). 

J a 



Example 1 

For each u in [a, 6], let 

Ju{t) 

for IX > a, and let 

Ja{t) 



0 for t < 

1 for t > 



0 for t = a, 

1 for t > a. 



Then is an increasing step function with jump 1 dX u. Also, every 
bounded function / on [a, b] is J^^-integrable and 



f fdJu = f{u). 

J a 
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More generally, if ixi, 1x2, • • • , '^m are distinct points in [a, 6] and if 
ci, C2, . . . , are positive numbers, then 

m 

is an increasing step function with jumps Cj at Uj. See Fig. 35.1 for a 
special case. Every bounded function / on [a, h] is F-integrable and 



fdF = J2cj-f{i 



(1) 



To check (1), first note the validity of (1) will not change if some 
of the Uj are not jump points so that cj = 0. So we may assume a 
and b are in {uj : I < j < m}, and a = ui < U2 < - - • < Um = b. Let 
P be the partition {a = ui < U2 < - - - < Um = b}. Then we have 
F{uj) - F{uJ) = Cj for j = 1, 2, . . . , m and F{uJ) - F{uj_^) = 0 
for j = 2, 3, . . . , m. Therefore 

m 

UFif, P) = Lp{f, P) = Jpif, P) = J2 /(«^) • 

i=i 
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for any bounded function / on [a, 6]. From (7) and (8) in 
Definition 35.2 and ^ Upif), it follows that 

m 

UF{f)=LF{f)=j2f(''jy^j' 

Hence / is F-integrable and (1) holds. □ 
Example 2 

We specialize Example 1 to the case ui = 0, U2 = I, us = 2, U4 = 3; 
ci = C4 = |, C2 = C3 = |. Thus we must have a < 0 and 6 > 3; see 
Fig. 35.1. For any bounded function / on [a, 6], we have 

ljdF= i/(0) + ^/(l) + ^/(2) + 1/(3). 



35.3 Lemma. 

Let f be a bounded function on [a^b], and let P and Q be partitions 
of [a, b] such that P ^ Q. Then 

LfU, P) < Lpif, Q) < Upif, Q) < Upif, P). (1) 

Proof 

We imitate the proof of Lemma 32.2 on page 273 down to, but not 
including, formula (3). In the present case, the difference Lp{f^ Q) — 
LF{f, P) equals 

f{u) ■ [F{u+) - F{u-)] + m{f, ih-i,u)) ■ [Fiu-) - Fit+_i)] 
+m{f,{u,tk))-[F{q)-F{u+)] (3) 
-m(/, {tk-i,tk))-[F{t^)-F{t+_,)], 

and this is nonnegative because 

mif,{tk-i,tk))-[Fit^)-Fit+_,)] 

= m{f, {tk-i,tk)) ■ [F{t^) - F{u+) + F{u+) - F{u-) 

+Fiu-)-Fi4_,)] 
< m{f, {u,tk)) ■ [F{t^) - F{u+)] + f{u) ■ [F{u+) - F{u-)] 
+mif,{tk-i,u))-[Fiu-)-Fi4_,)]. 
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35.4 Lemma. 

If f is a bounded function on [a, b] and if P and Q are partitions of 
[a,h], then Lpif ,P) <UF{f ,Q) ■ 

Proof 

Imitates the proof of Lemma 32.3 on page 273. ■ 

35.5 Theorem. 

For every bounded function f on [a^b], we have L^if) < Upif)- 
Proof 

Imitates the proof of Theorem 32.4 on page 274. ■ 

35.6 Theorem. 

A bounded function f on [a, 6] is F-integrable if and only if for each 
e > 0 there exists a partition P such that 

UFif,P)-LF{f,P)<e. 

Proof 

Imitates the proof of Theorem 32.5 on page 274. ■ 

We next develop analogues of results in §33; we return later to 
generalizations of items Definition 32.6 through Theorem 32.9. We 
begin with the analogue of Theorem 33.2. The analogue of Theo- 
rem 33.1 is true, but its proof requires some preparation, so we defer 
it to Theorem 35.16. 



35.7 Theorem. 

Every continuous function f on [a, b] is F-integrable. 
Proof 

To apply Theorem 35.6, let e > 0. Since / is uniformly continuous, 
there exists 6 > 0 such that 

x,y G [a,6] and \x-y\ < 6 imply \f{x)-f{y)\ < ^^^^ - F{a) ' 

Just as in the proof of Theorem 33.2, there is a partition P of [a, b] 
such that 

M(/, {tk-i,tk))-m{f, < ^^^^ ' p^^^ 
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for each k. Hence by (4) of Definition 35.2 we have 

Theorem 35.6 now shows / is F-integrable. ■ 

35.8 Theorem. 

Let f and g be F-integrable functions on [a^b], and let c be a real 
number. Then 

(i) cf is F-integrable and J^{cf)dF = c f dF; 

(ii) f + gis F-integrable and J^{f + g) dF = f dF + g dF . 
Proof 

Imitates the proof of Theorem 33.3, using Theorem 35.6 instead of 
Theorem 32.5. ■ 

35.9 Theorem. 

/// and g are F-integrable on [a, 6] and if f{x) < g{x) for x G [a^b], 
then jlfdF < J^gdF. 

Proof 

Imitates the proof of Theorem 33.4(i). ■ 

35.10 Theorem. 

/// is F-integrable on [a,b], then \ f\ is F-integrable and 



b 



fdF 



< f\f\dF 

J a 



Proof 

Imitates the proof of Theorem 33.5 and uses formula (4) of 
Definition 35.2. ■ 

35.11 Theorem. 

Let f be a function defined on [a, 6]. If a < c < b and f is F-integrable 
on [a,c] and on [c^b], then f is F-integrable on [a, 6] and 

fdF= r fdF+ f fdF (1) 
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Proof 

Imitates the proof of Theorem 33.6. Note that an upper or lower sum 
on [a,c] will include the term /(c)[F(c) — F{c~)] while an upper or 
lower sum on [c, 6] will include the term /(c)[F(c+) — F{c)]. ■ 

The next result clearly has no analogue in §32 or §33. 

35.12 Theorem. 

(a) Let Fi and F2 be increasing functions on [a, 6]. // / is Fi- 
integrable and F2-integrable on [a,b] and if c > then f is 
cFi-integrable, f is {Fi ^ F2)-integrable, 

f fdicFi) = c [' fdFu (1) 

J a J a 

and 

f f d{Fi + F2) = f f dFi + f f dF2. (2) 

J a J a J a 

(b) Let (Fj) be a sequence of increasing functions on [a, 6] such that 
F = X^^i Fj defines an (automatically increasing) function on 
[a, b]. Thus the series converges on the entire interval [a, b], and 
F(a) and F{b) are finite. If a bounded function f on [a, 6] is 
Fj -integrable for each j, then f is F-integrable on [a, 6] and 



/ fdF^Y. w 



(3) 



Proof 

From Theorem 20.4 we see 

(Fi + F2)(t+) = lim [Fi{x) + F2{x)] = lim Fi{x) + lim F2{x) 

= Fl(^+) + F2(t+) 

with similar identities for (Fi + F2)(t"), (cFi)(t+) and (cFi)(t"). 
Hence for any partition P of [a, 6], we have 

Ufm if, P) = Uf, if, P) + Uf, if, P) .4. 

LF,+FAf,P) - LF,{f,P) + LFAf,P), ^ ^ 
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UcFi (/, P) = c[/fi (/, P) and L^Fi (/, P) = cLf^ (/, P). It is now clear 
that / is cFi-integrable and that (1) holds. To check (2), let e > 0. 
By Theorem 35.6 and Lemma 35.3, there is a single partition P of 
[a, b] so that both 

UFAf,P)-LFAf,P)<l and UF,{f,P)-LF,{f,P)<^. 
Hence by (4) we have 

UF,+F,{f,P)-LF^+F,{f,P)<^- 

This and Theorem 35.6 imply / is (Fi +F2)-integrable. The identity 
(2) follows from 

f fd{Fi+F2) < UF,+F,{f,P) < LF,+F,{f,P) + e 
J a 

= Lf, if, P) + Lf, if, P)+e< ffdFi+ ffdF2 + e 

J a J a 

and the similar inequality 

f fd{Fi+F2)> f fdFi + f fdF2-e. 

J a J a J a 

Now we prove part (b). We write Sm for Yl^=i Pj Pm ioi the 
difference (or tail sum) F — Sm = X^j^m+i ^j- P be a positive 
bound for |/| on [a, 6], and consider e > 0. Select a positive integer 
mo so that 

\Pm{b) - T^(a)| < ^ for m> mo. (5) 



We will show 



UF{f)-LF{f)<j. (6) 



Since e > 0 is arbitrary, this will imply Upif) ^ LF{f)^ so that / is 
F-integrable. We will also show 

rh rb 

< e for m > mo. (7) 



fdF- / fdS., 



Since e > 0 is arbitrary, and f dSm — X^^i la f ^-^j (2)' ^^^^ 



will confirm (3). 
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We now prove (6). First we claim 

\UF{f^P) — Us^{f^P)\ < ^ for all partitions P of [a, 6] and m > mo, 

(8) 

\LF(f^P)—Ls^(f^P)\ < - for all partitions P of [a, 6] and m > mo. 

5 

(9) 

Let P = {a = to < ti < . . . < = 6}. Note = ET=m+i ^3 is 
an increasing function on [a, 6], so using Eq. (2) in Definition 35.2 on 
page 300, the left-hand side of inequality (8) is bounded by 

n n 
k=0 k=l 

This sum is equal to 5[T^(6+) -T^(a-)] = 5[T^(6) -T^(a)] which, 
by (5), is less than |, so (8) holds. The verification of (9) is similar. 

In view of (2), / is S^-integrable for each m, so for each m there 
is a partition of [a, b] satisfying 

UsAf,Pm)-LsAf,Pm)<l. (10) 

Now we apply the triangle inequality to (8) and (9) [with P = Pm] 
and (10) to obtain 

UF{f.Pm)-LF{f,Pm)<4 m > mo- (11) 

5 

This implies (6); therefore / is P-integrable. 
Now (11) and (10) imply 

UF{f,Pm)- J' fdF<j and Usjf, Pm) - j' fdS^ < ^ 
for m > mQ. Applying these inequalities and (8), we obtain 



rb rb 

/ fdF- fdS„ 

J a J a 



< e for m > mo. 



i.e., (7) holds. 
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Example 3 

(a) Let (uj) be a sequence of distinct points in [a, 6], and let (cj) be 
a sequence of nonnegative numbers^ such that < oo. Using the 
notation of Example 1 on page 301, we define 

oo 

Then F is an increasing function on [a, 6]; note F{a) = 0 and F{b) = 
Cj < oo. Every bounded function / on [a, b] is F-integrable and 

fdF^Y.^,f{u,). (1) 

This follows from Theorem 35.12(b) with Fj = CjJu -, since every 
bounded function is Fj-integrable for every j, as shown in Example 1. 
(b) The function F in part (a) satisfies 

F{t) = "^{cj : Uj < t} for t G (a, 6], (2) 

since Juj{t) = 1 if and only if uj < t. Also F{a) = 0. Moreover, 

F{t~) = "^{cj : Uj < t} for t G (a, 6], (3) 

since F{t~) = lim^,^^- J2{^j • '^j ^ We also have 

F(t+)=F(t) for tG(a,6], (4) 

because = ^(^) by decree, and for t G (a, 6) and x > t, we 

have 

F(x)-F(t) = 5^{c, :t<^., <x}, (5) 

SO that F{t^) = lim2,^^+ = F{t). [Details: Given 6 > 0, there 
is N so that X^^^y+i ^ ^- -^^^ a:^ > t and x sufficiently close to t, 
the sets {uj : t < uj < x} and {ixi, . . . ^uj^} are disjoint, so the sum 
in (5) is less than e.] 



^Allowing some c^'s to be 0 won't change the value of F, of course, but allowing 
Cj's to be 0 is sometimes convenient. 
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(c) A function F is said to be right continuous at t if F{t) = 
F{t^). Equation (4) shows F is right continuous except possibly 
at a. By (4), (2) and (3), we have 

- Fit-) = 5]{c, : u, = t}. (6) 

Equation (6) holds for all t in [a, 6], even t = a. Therefore, F is contin- 
uous at t unless t = uj for some j. Finally, F is clearly discontinuous 
at each uj unless cj = 0. □ 

The next theorem shows F-integrals can often be calculated using 
ordinary Riemann integrals. In fact, most F-integrals encountered in 
practice are either covered by Example 3 or this theorem. 

35.13 Theorem. 

Suppose F is differentiable on [a, 6] and F' is continuous on [a, 6]. // 
/ is continuous on [a^b], then 

f fdF= f f{x)F'{x)dx. (1) 

J a J a 

Proof 

Note fF' is Riemann integrable by Theorem 33.2, and / is F- 
integrable by Theorem 35.7. By Theorems 32.5 and 35.6, there is 
a partition P — {a = t^) < ti < - - - < t^ — h} such that 

U{fF',P)-L{fF',P)<'- and UF{f,P)-LF{f,P)<'-. (2) 

By the Mean Value Theorem 29.3 on page 233 applied to F on each 
interval [tk-i^tk]^ there exist Xk in (tk-i^tk) so that 

F{tk) - F{tk-i) = F\xk){tk - tfc-i); 

hence 

n n 

J2 f^^k) ■ [F{tk) - F{tk-i)] = J2 fi^k)F\xk) ■ {tk - tk-i). (3) 

k=l k=l 

Since F is continuous, it has no jumps and (3) implies 

LF{f,P)<U{fF',P) and L{fF',P)<UF{f,P). 
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Now by (2) we have 

fj'^F^ Upif, P)<^+LF{f,P)<^ + UifF', P) 

< ^ + I + L{fF', P)<^ + f f{x)F'{x) dx 

and similarly / dF > f{x)F'{x) dx — e. Since e > 0 is arbitrary, 
(1) holds. ■ 
An extension of Theorem 35.13 appears in Theorem 35.29. 

Example 4 

Let F{t) = 0 for t < 0, F{t) = for 0 < t < 2, and F{t) = t + 5 
for t > 2; see Fig. 35.2. We can write F — Fi + 3 J2 where Fi is 
continuous and J2 is the jump function at 2. The function Fi is 
differentiable except at t = 2; the differentiability of Fi at t = 0 is 
shown in Exercise 28.7. Let / be continuous on [—3,3], say. Clearly 
f d^Fi — 0- Since Fi agrees with the differentiable function on 
[0,2], we can apply Theorem 35.13 to obtain 



fdFr 



2 r2 

f{x) ' 2xdx — 2 I xf{x) dx. 
0 Jo 
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Similarly we have 



f fdFi= f f{x)-ldx= f f{x)dx. 

J2 J2 J2 

Theorem 35.11 now shows 

r / dFi = 2 xf{x) dx + r f{x) dx, 

J-3 Jo J2 

and then Theorem 35.12(a) shows 

/3 />3 />3 n2 p3 

fdF= fdFi^S fdJ2=2 xf{x)dx^ f{x)dx^3f{2). 
-3 J-3 J-3 Jo J2 

As a specific example, if f{x) = x^, then 



fdF = 2l x'^dx^ I x^dx + 3-8 = = 53.05. 



3 JO 



□ 



For the proof of Lemma 35.15, we will use the next theorem, 
which is interesting in its own right. 

35.14 Theorem. 

Let F be a right- continuous increasing function on [a, 6]. Then we 
have F = Fc + F^, where Fc is a continuous increasing function on 
[a, b], and = ^ cjJuj where {ui,U2, . . .} are the jump points of F 
and Cj is the jump at Uj, i.e., Cj = F{u^) — ^i^j) f^^ ^^^^ 3- i^f 
there are no jump points, then F is continuous, F — Fc and = 0.) 
In general, there might be finitely many or infinitely many such Uj^ 
so we will not decorate the sums until we need to. 



See Examples 1 and 3 on pages 301 and 309 for the notation. The 
function Fc is called the "continuous part" of F, and F^ is called the 
"discrete part" of F. 
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Proof 

Let Fc = F — Ffi- To show Fc is an increasing function, it suffices to 
sliow s <t implies Fc{s) < Fc{t)^ i.e., 

s < t implies Fd{t) - Fd{s) < F{t) - F{s). 

By (2) in Example 3(b) on page 309, it suffices to show 

s < t implies ^{c^- : s <Uj <t} < F{t) - F{s). (1) 

To show this, it suffices to consider a finite subset E of {uj : s < 
Uj < t}, which we write as {to < ti < • • • < tn} where s < to and 
tn<t. Then 

J2{cj : G E} = < F{t^)-F{s) = F{t)-F{s) 

by (6) in Definition 35.2 on page 300 with a = s and b = t. Since E 
is an arbitrary finite subset of {uj : s < uj < t}, (1) holds. 

To show Fc is continuous, first note that if t / uj for all j, then F 
is continuous at t, and F^ is continuous at t as shown in Example 3(c). 
So Fc = F — Fd is continuous at t in this case. Otherwise, t = uj 
for some j. Then F{u^) — F{uj) = Cj by the definition of Cj, and 
Fd{u^) - Fd{uj) = Cj by (6) of Example 3(b). Therefore 

F,iu+) - F,{u-) = Fiu+) - Fdiup - F{uj) + F^iuj) 

= [F{up - F{u-)] - [Fdiup - FdiuJ)] = Cj - Cj = 0, 
SO that Fc is continuous at u j , as claimed. ■ 

It is easy to check that the representation of F as Fc + Fd is 
unique in the following sense: If Fc+Fd = Gc + Gd where G is another 
right-continuous increasing function, then Fc = Gc and Fd = Gd- 

35.15 Lemma. 

If F is an increasing function on [a, b] and if e > 0, then there exists 
a partition 



P = {a = to <ti < <tn = b} 
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such that 

F{q)-Fit+_,)<e for k = l,2,...,n. (1) 

Proof 

The conclusion (1) does not depend on the exact values of F at any of 
its jump points, though of course they satisfy F{t~) < F{t) < F{t^). 
Hence it suffices to prove (1) after F has been redefined at its jump 
points. We choose to define F{t) = F{t^) at all jump points, so that 
F is right continuous on [a, 6]. 

Now that F is right continuous, we can apply Theorem 35.14: 
F = Fc + ^CjJuj where Fc is continuous, each Cj is positive, and 
^ Cj < oo. If F is continuous, then the sum disappears and the proof 
below can be simplified. 

Given e > 0, select so that Y1^=n^i ^ f • Again, if there are 
only finitely many i^j's, this part of the proof simplifies. Since Fc is 
uniformly continuous on [a, 6] [by Theorem 19.2 on page 143], there 
is 5 > 0 so that 

\s-t\<5 implies \Fc{s) - Fc{t)\ < ^. (2) 

Let P = {a = to < ti < • • • < tn} be a partition that includes 
{ixi, . . . , un} and satisfies \tk — tk-i\ < 5 for A; = 1, 2, . . . , n. Let 

TV oo 

Fi = "^CjJu^ and F2 = ^ c^J^., 
j=i j=N+i 

so that F = Fc + Fi + F2. For each /c = 1, 2, . . . , n, we have 
FS^) - FSt-i) = Fc{tk) - FSk-i) < I by (2), 

Fi{t-^)-F,{tU)^Q 
because Fi is constant on the open interval {tk-i,tk), and 

(X) 

F2{t-) - F2{tt_,) < F,{b) - F,{a) < J2 ^3<\' 

j=N+l 

Since F = Fc + Fi + F2, summing yields F(t^) - F{t'^_^) < e. ■ 
35.16 Theorem. 

Every monotonic function f on [a, b] is F-integrable. 
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Proof 

We may assume / is increasing and /(a) < f{b). Since /(a) < f{x) < 
f{b) for all X in [a, 6], / is bounded on [a, 6]. For e > 0 we apply 
Lemma 35.15 to obtain P = {a = to < < • • • < = 6} where 

for A; = 1,2,..., n. Since M{f,{tk-i,tk)) = f{t^) < f{tk) and 
Mf, {tk-i,tk)) = f{tk-i) > fitk-i), we have 

n 

UF{f,P) - LF{f,P) < ^[f{tk) - f{tk-i)] ■ [F{t^) - F{t+_i)] 

k=i 

<![/(« -/«.-.)] ^7^^ = . 

Since e is arbitrary, Theorem 35.6 shows / is F-integrable. ■ 



35.17 Theorem. 

// / is piecewise continuous, or bounded and piecewise monotonic, 
on [a^b], then f is F-integrable. 

Proof 

Just as in the proof of Theorem 33.8, this follows from The- 
orems 35.7, 35.16 and 35.11, provided we have the following 
generalization of Exercise 32.7. ■ 



35.18 Proposition. 

/// is F-integrable on [a, 6] and g{x) = f{x) except for finitely many 
points, then g is F-integrable. We do not claim f dF = gdF. 

Proof 

It suffices to show g — f is F-integrable, because then the sum 
{9 ~ f)^f would be F-integrable by Theorem 35.8(ii). Thus it 
suffices to assume g{x) = 0 except for finitely many points. Consider 
any partition P = {a = to < ti < • • • < tn = b} satisfying g{x) = 0 
for all X in [a, 6] \ {to, ti, . . . , t^}. Then from Eqs. (2) and (3) in Def- 
inition 35.2 on page 300 we have UF{g,P) = Jf(^,F) = LF{g,P), 
so g is clearly F-integrable; see Theorem 35.6, for example. ■ 
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If Fi and F2 are increasing functions with continuous deriva- 
tives, then Theorem 35.13 allows the formula on integration by parts 
[Theorem 34.2] to be recast as 

/ FidF2+ / FsdFi =Fi (6)^2(6) -Fi(a)F2 (a). 

J a J a 

There is no hope to prove this in general because if = 0 for 
t < 0 and F{t) = 1 for t > 0, then 

J FdF + J FdF = 2/l = F(l)F(l)-F(-l)F(-l). 

The generalization does hold provided the functions in the integrands 
take the middle values at each of their jumps, as we next prove. The 
result is a special case of a theorem given by Edwin Hewitt [29]. 

35.19 Theorem [Integration by Parts]. 

Suppose Fi and F2 are increasing functions on [a, b] and define 

F^{t)^\[F,{t-) + F^{t+)] and F^* (t) = ^[^2^) + i^2(i+)] 
for all t G [a, b]. Then 

f dF2 + f F^ dFi = Fi {h)F2 {h) - Fi {a)F2 {a). (1) 

J a J a 

As usual, we decree = Fi{b), Fi{a~) = Fi{a), etc. 

Proof 

Both integrals in (1) exist in view of Theorem 35.16. For an 6 > 0, 
there exists a partition P = {a = to < ti < • • • < tn = b} such that 

UFdF^,P)-LFdF^,P)<e. 

Some algebraic manipulation [discussed in the next paragraph] shows 

Up, (F; , P) + Lf, (FI , F) = Fi (6)F2 (b) - Fi (a)F2 (a) , (2) 

SO that also 

Uf, {F; , P) + Lf, (F; , F) = Fi (6)F2 (6) - Fi (a)F2 (a) . (3) 
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It follows from (2) that 

b rb 

F^dF2 + J F^dFr<UFAFt.P) + UFAF2.P) 

<UF,{F^,P) + LFAF;,P) + e 
= Fi{b)F2{b)-Fi{a)F2{a)+e, 

while (3) leads to 

b rb 

Fi* dF2 + / F* dFi > Fi{h)F2{h) - Fi{a)F2{a) - e. 

J a 

Since e is arbitrary, (1) holds. 

It remains to verify (2). Observe 

n 

Up, (Ff , P) + Lp, {F^,P) = Fiitk) ■ [F2{tt) - F2{t^)] 

n 

+ Y,M{F*,{tk-i,tk)) ■ [F2{t-) - F2(t+_i)] 

n 

+ J2F;{U)-[F,{tt)-F,{t-)] 

n 

+ J2MF^,itk-i,tk)) ■ [Fi{t^) - F,{t+_,)] 

n 

= E 2^F^^^k) + • mt) - F,{t-)] 

n 

+ J2F^{t-)-[F2{t-)-F2{t+_,)] 

k=l 
n 

+ j2F^('ti)-{Fi{t^)-F^{tU)]. 
The first and third sums add to 

n 

J2mt)F2itt) - F,{t^)F,it^)], (4) 



L 
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while the second and fourth sums add to 

n 

J2 [mDmu) - F,{tU)F2{tU)]. (5) 

k=i 

Since the sums in (4) and (5) add to ^1(6)^2(6) - Fi(a)F2(a), by 
Eq. (6) in Definition 35.2 [on page 300] apphed to F1F2, the equahty 
(2) holds. The preceding algebra simplifies considerably if Fi and F2 
are continuous. ■ 



We next compare our approach to Riemann-Stieltjes integration 
to the usual approach. For a bounded function / on [a, 6], the usual 
Darboux-Stieltjes integral is defined via the upper sums 

n 

k=i 

and the lower sums 

n 

k=i 

The expressions UF{f)i ^F{f) and J^f dF are defined in analogy to 
those in Definition 35.2 on page 300. The usual Riemann-Stieltjes 
integral is defined via the sums 

n 

k=i 

where Xk is in [tk-i^tk]^ and the mesh is defined in Definition 32.6; 
compare Definition 35.24. 

The usual Riemann-Stieltjes integrability criterion implies the 
usual Darboux-Stieltjes integrability criterion; these criteria are not 
equivalent in general, but they are equivalent if F is continuous. 
See, for example, [53, §12.2], [55, Chap. 8], or [62, Chap. 6], the most 
complete treatment being in [55]. 

35.20 Theorem. 

// / is Darboux-Stieltjes integrable on [a, b] with respect to F in the 
usual sense, then f is F-integrable and the integrals agree. 
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Proof 

For any partition P, LF{f,P) equals 

n 

Y,m{f, [tk-iM) ■ [F{tk) - F{tl) + F{tl) - Fit+_,] 
k=i 

+F{t+_,) - F{tk-i)] 

n 

k=i 

n 

k=i 

n 



k=i 

The first and third sums add to 

n n—1 

j2fitk)[F{tk) - F{t^)] + j2f{tkmt+) - F{tk)] 

k=l k=0 

n-1 

= /(in)[i^(tn) - Fit-)] + J2f{tkmt+) - F{t^)] 

k=l 

+f{t,)[F{t+)-F{to)] 

n 

= j2mmt+) - F{t^)] = Mf,p). 

k=0 

These observations and a glance at the definition of Lpif^ P) now 
show LfU^P) <LfU^P)' Likewise we have Urif^P) > UpO^P), 
so 

UfU. p) - LfU, P) < UfU, p) - LfU, P). (1) 

If e > 0, the usual theory [Theorem 32.5] shows there exists a parti- 
tion P such that Urif, P) — Lpif, P) < By (1) we see that we also 
have Urif, P) — Lpif^ P) < e, so / is F-integrable by Theorem 35.6. 
To see equality of the integrals, simply observe 

/ f dF < UF{f,P) < LF{f,P) + e < LF{f,P) + e < f f dF + e 

J a J a 
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and similarly 

fdF> I fdF-e. 



We will define Riemann-Stieltjes integrals using a mesh defined 
in terms of F instead of the usual mesh in Definition 32.6. 

35.21 Definition. 

The F-mesh of a partition P is 

F-mesh(P) = max{F(t^) - F{t^_^) : A: = 1, 2, . . . , n}. 



It is convenient to restate Lemma 35.15: 

35.22 Lemma. 

If S > 0, there exists a partition P such that F-mesh(P) < 5. 

35.23 Theorem. 

A hounded function f on [a, 6] is F-integrable if and only if for each 
e > 0 there exists 6 > 0 such that 

F-mesh(P) < S implies Urif, P) - LpU^ P) < ^ (1) 

for all partitions P of [a, b]. 

Proof 

Suppose the e-5 condition stated in the theorem holds. If we have 
e > 0, then (1) applies to some partition P by Lemma 35.22 and 
hence Upif^P) — Lpif^P) < e. Since this remark applies to all 
e > 0, Theorem 35.6 implies / is P-integrable. 

The converse is proved just as in Theorem 32.7 with "mesh" 
replaced by "F-mesh" and references to Lemma 32.2 replaced by 
references to Lemma 35.3. ■ 

35.24 Definition. 

Let / be bounded on [a, 6], and let 



P = {a = to < ti < ' • ' < tn = b}. 
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A Riemann-Stieltjes sum of / associated with P and F is a sum of 
the form 

n 

JF{f,P) + Y.f{x,)[F{t^)-F{4_,)] 

k=l 

where Xk is in (tk-i^tk) for /c = 1, 2, . . . , n. 

The function / is Riemann-Stieltjes integrahle on [a, h] if there 
exists r in R with the following property. For each e > 0 there exists 
5 > 0 such that 

\S-r\<e (1) 

for every Riemann-Stieltjes sum S of f associated with a partition 
P having F-mesh(P) < 5. We call r the Riemann-Stieltjes integral 
of / and temporarily write it as 

nS fdF. 

35.25 Theorem. 

A bounded function f on [a, b] is F-integrable if and only if it is 
Riemann-Stieltjes integrable, in which case the integrals are equal. 

Proof 

The proof that F-integrability implies Riemann-Stieltjes integrabil- 
ity imitates the corresponding proof in Theorem 32.9. The proof of 
the converse also imitates the corresponding proof, but a little care 
is needed, so we give it. 

Let / be a Riemann-Stieltjes integrable function, and let r be as 
in Definition 35.24. Consider e > 0, and let 5 > 0 be as provided 
in Definition 35.24. By Lemma 35.22 there exists a partition P = 
{a = to < ti < • • • < tn — b} with F-mesh(P) < 5. For each k = 
1,2, ... ,n, select Xk in {tk-i,tk) so that f{xk) < m{f, {tk-i,tk)) + e. 
The Riemann-Stieltjes sum S for this choice of x^s satisfies 

S<Lpif,P) + e[F{b)-Fia)] 



and also 
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hence Lpif) > Lpif^P) > r - e - e[F{b) - F{a)]. Since e > 0 
is arbitrary, it follows that LF{f) > r and similarly UF{f) < r. 
Therefore Lpif) = Upif) = r. Thus / is F-integrable and 



35.26 Remarks. 

In the definition of upper and lower Darboux sums, we used 
closed intervals [tk-i,tk] for Riemann integrals, in §32, and we 
used open intervals {tk-i,tk) in this section. The reason we used 
closed intervals in §32 is because that is completely standard. 
The reason we used open intervals in this section is because 
our development was motivated by the desire to have Riemann- 
Stieltjes integrals more compatible with their measure-theoretic 
generalization, Lebesgue-Stieltjes integrals, where the "measurable 
partition" 



is a natural starting point. Moreover, the arguments in Examples 1 
and 3 and in Proposition 35.18 would be somewhat more complicated 
if we had used closed intervals. 

The reader may wonder whether the theories would have changed 
if we had used closed intervals in this section or open intervals in 
§32. It turns out there would be no essential changes, as we now 
explain. We do so using increasing functions F, as in this section; see 
Corollary 35.28 for the case of Riemann integrals. We write LF{f, P) 
and Upif^P) for the lower and upper Darboux-Stieltjes sums using 
closed intervals [tk-i^tk] instead of open intervals {tk-i^tk). These 
will sometimes be different from the corresponding Darboux-Stieltjes 
sums defined in Definition 35.2 on page 300. But if we define 




n n 



k=0 k=l 



Upif) = mf{UF{f,P) ■■ P partitions [a,b]} 



and we define LF{f) similarly, we have the following fact. 
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35.27 Proposition. 

/// is bounded on [a,b], then U pif) = Upif) and LF{f) = LF{f). 
Thus f is integrable using closed intervals in the Darboux-Stieltjes 
definitions if and only if it is integrable using open intervals, and in 
this case the integrals are equal. 

Proof 

We prove U pif) — Upif)] the proof of LF{f) = LF{f) is similar. 
For each partition P of [a, 6], it is clear that Upif^P) < Upif^P)- 
Therefore Upif) < Upif) and it suffices to show 

UFif) < UFif). (1) 

Let e > 0. There is a partition P of [a, b] such that 

UF{f,P)<Up{f)+'-. (2) 

Note (2) holds for any refinement of P by Lemma 35.3. 

As before, if there are any jumps we list them as ui,U2, • • • and 
define cj = — F{uJ)- Since is finite, there is an integer 

N so that J2^N^i^j < f - Of course, this step is trivial if F has 
only finitely many jumps. We first refine P so that for every j < N, 
the jump Uj is equal to some tj^ in P. Then if Pi and P2 are such 
refinements of P, we have 

00 

iJf(/,pi)-Jf(/,p2)i< J2 ^j<l' (3) 

j=N+l 

Now we further refine P as follows. Using the definitions of F{t'^) 
and F{t^), we see there are points Sk and ix/^; for /c = 0, 1, . . . , n so 
that 

a = Sq = to < Uq < Si < ti < Ui < S2 < t2 < U2 < Ss < • • • 



" < Sn-1 < tn-l < Un-1 < Sn < tn = Un = b, 

and all P(% ) - F{t^) and F{t^) - F{s^) are less than 4(^_^i)^ , 
where P is a positive bound for the absolute value |/|. We estimate 
?7i?(/, P^) for the new partition P^ consisting of all 5^, tk and Uk- 
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Observe: 

n n 
k=0 k=0 



k=0 k=0 



and 5;^M(/,[./,_i,.,]) . [F{s-)-F{ul_,)] 
k=i 

n 

< J] M(/, t,)) • [F(t-) - F{4_,)] = ^^(/, P) - Mf. P). 
k=i 

Summing these three inequahties, we see 



f/f - Jf(/,P«) < UFif,P) - JfU.P) + |- 

Now we invoke (3) to conclude 

fJf (/, P») < C/f (/, P) - (/, P) + Jf(/, i'") + 1 < Upif, P) + |. 

Finally, using (2), we obtain Upif^P'^) < Upif) + e; hence 

UF{f)<UF{f,P^)<UF{f) + e. 
Since e is arbitrary, (1) is established. ■ 

Proposition 35.27 is true for F{t) = t, so it is true for Riemann 
integrals. However, for this important case, we use closed intervals as 
is traditional. Thus our notation ?7(/, P), U{f) refers to the theory 
using closed intervals, and we do not want to confuse the situation 
here by switching to [/(/, P, U{f), etc. To distinguish the theory 
using open intervals, we introduce new notation U\f, P), U\f), etc. 

35.28 Corollary. 

In ^32, on the Riemann integral, the definitions of L{f^P) and 
U{f, P) for upper and lower Darboux sums could have used open 
intervals {tk-i,tk) instead of closed intervals [tk-i^tk]- The resulting 



§35. * Riemann-Stieltjes Integrals 325 



Darhoux sums U[f^P) and U {f^P) might be different. But if we 
define 



and we define L^{f) similarly, then we have U (f) — U{f) and 
L^{f) — L{f). Thus the two approaches to Riemann integration give 
the same integrals. 

Proof 

This is Proposition 35.27 for F{t) = t; only the notation here is 
different. ■ 

We next give a generahzation of Theorem 35.13. The proof is 
somewhat comphcated and uses Corollary 35.28. It was originally 
worked out by me and my colleague Theodore W. Palmer. 

35.29 Theorem. 

Suppose F is differentiate on [a, 6] and F' is Riemann integrable on 
[a, 6]. A bounded function f on [a, 6] is F -integrable if and only if 
fF' is Riemann integrable, in which case 



We will give the proof after Lemma 35.30 and its corollary. 
First look at Definition 35.2 on page 300. Being differentiable, F is 
continuous. So the Jp terms in the definition are 0, and we have 



U\f) = ini{U\f,P) : P partitions [a, 6]} 




fdF 




n 



k=i 



and 



n 



LFif.P) = • [F{tk)-F{tk_i)]. 



k=i 



We will use these formulas in the proof of Lemma 35.30 below. We 
also use the notation U^{f), etc., from Corollary 35.28. 
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35.30 Lemma. 

Assume F is differentiable on [a,b], F' is Riemann integrable on 
[a, 6]^ and f is a bounded function on [a, 6]. Let B be a positive bound 
for \f\. If we have U\F' , P) - L\F' , P) < e/B, then 

\UF{f,P)-U\fF\P)\<e (1) 

and 

\LF{f,P)-L\fF',P)\<e. (2) 

Proof 

Let P = {a = to < ti < • • • < tn = b}. By the Mean Value 
Theorem 29.3, for each k there exists Xk in (tk-i^tk) so that 

F{tk) - F{tk-i) = F'{xk) • {tk - tk-i). (3) 

Now consider an arbitrary i/k in (tk-i^tk) and observe 

n 

J2 \F\^k) - F\yk)\ . {tk - tk_,) < U\f\ P) - L\f\ P) < ^ (4) 

k=i 

since the sum is bounded by Yl^=i[^{F' A^k-iitk)) 
— m{F\ {tk-i,tk))] ' {tk — tk-i)' Applying this and (3), we obtain 

= I ELi fivk) ■ F'ixk) ■ (tk - tk-i) - ELi fivk) ■ F'ivk) ■ (tk - tk-i)\ 

< ELi \fiyk)\ ■ \F'{xk) - F'{yk)\ ■ {tu - tk-i) 

< B ■ ELi \F'ixk) - F'{yk)\ ■ {tk - tk-i) < e. 

Therefore for in we have 

ELi f{yk)[F{tk) - F{tk-i)]<e+ ELi fiVk) ■ F'{yk) ■ {tk - tk-i) 

< e + ELi M{fF', {tk-i,tk)) ■ {tk - tk-i) = e + U\fF', P) 

(5) 

and 

ELi fi^Vk) ■ F'{yk) ■ {tk - tk-i)<e+ ELi f{yk)[F{tk)-F{tk-i)] 

< e + ELi ^(/' {tk-i,tk))[F{tk) - F{tk-i)] = e + C/f(/, P). 

(6) 
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Since (5) and (6) hold for arbitrary yj^ in (tk-i^tk), for each A;, we 
conclude^ 

n 

Upif, P) = Y1 ^(/' itk-i,tk)) ■ [F{tk) - F{tk-i)] < e + U\fF', P). 
k=l 

(7) 

and 

n 

k=i 

Now (1) follows from (7) and (8); (2) has a similar proof. ■ 
35.31 Corollary. 

With F and f as in Lemma 35.30, we have Upif) = U{fF') and 
LF{f) = L{fF'). 

Proof 

Consider e > 0. Select partitions Pi and P2 of [a,b] so that 

\UF{f,Pi)-UF{f)\<e and \U{fF')-U\fF',P2)\<e. 

Such a partition P2 exists because U{fF') — U^{fF') by Corol- 
lary 35.28. Since F' is Riemann integrable by hypothesis, U^{F') = 
U{F^) = L{F^) = L^{F^). So there exists a partition P3 so that 

U\F',P^)-L\F',P^)<e/B. 

The last three inequalities still hold if we replace Pi,P2 5^3 by a 
common refinement P. Now by Lemma 35.30, we have 

\UF{f,P)-U\fF\P)\<e, 

SO by the triangle inequality, we have 

\UF{f)-U{fF')\<2,e. 

Since e is arbitrary, UfU) = U{fF'). Likewise Lpif) = L{fF'). ■ 



^Some readers may appreciate more explanation. To avoid breaking the flow of 
the proofs, this will be provided after the proof of Theorem 35.29 is completed. 
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Proof of Theorem 35.29 

Suppose / is F-integrable. Then Urif) = LpU)- Hence U{fF') = 
L{fF') by Corollary 35.31. Thus fF' is Riemann integrable and 



Now suppose fF' is Riemann integrable. Then U{fF') = L{fF')] 
hence Upif) = Lpif)- Thus / is F-integrable and 



How did we so quickly conclude inequalities (5) and (6) in 
Lemma 35.30? Intuitively, we knew we could select each so that 
f{yk) is very close to M(/, {tk-i,tk)), which appears in the definition 
of Upif^P) given after the statement of Theorem 35.29. Similarly, 
we concluded inequality (6) because we could select each yj^ so that 
{fF'){yj^) is very close to M{fF',{tk-i,tk)), which appears in the 
definition of U^{fF\P). In fact, these conclusions follow from the 
following lemma. 

35.32 Lemma. 

Suppose ai, . . . , are (fixed) nonnegative numbers and Bi, . . . , 
are nonempty bounded subsets o/R. If for some constant K, we have 




fdF^UF{f)^U{fF')^ / f{x)F'{x)dx. 





fdF 



n 




k=l 



for all choices of in B]^, /c = 1, 2, . . . 



n, then 



n 




k=l 



Proof 



We prove the following by induction on m = 



1,2,..., 



m—l 



n 
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for all choices of 6/^^ in S/^, /c = m, . . . , n." As always, sums Yl^=i 
Ylk=n+i taken to be 0. Assertion Pi holds by the hypothesis of 
the lemma. Assume Pm holds for some m = l,...,n — 1. Since bm 
in Bm is arbitrary, P^ implies 

m— 1 n 

Qm : "am sup 

k=l k=m+l 

for all choices of ^j^^^ in S/^, A; = m + 1, . . . but this is exactly 
assertion Pm+i- By induction, all and hold. Since Qn is the 
conclusion of the lemma, the proof is complete. ■ 

The nontrivial part of Exercise 4.14, sup A + sup 5 < sup(A + 5), 
is a special case of Lemma 35.32 where n = 2, ai = a2 = 1, Pi = A, 
B2 = P, and K = sup(A + P). 

Exercise 35.6 asserts fdF = limn^oo fndF provided the 
sequence (/^) of P-integrable functions converges uniformly to / on 
[a, 6]. Moreover, all of the comments in Discussion 33.10 carry over 
to this setting. 



Exercises 

35.1 Let F be an increasing function on [a, 6]. 

(a) Show linia,^^- F{x) exists for t in (a, b] and is equal to sup{P(x) : 
X e (a, t)}. 

(b) Show lim^^^+ F{x) exists for t in [a, b) and is equal to inf{P(x) : 

xe{t,b)}. 

35.2 Calculate Jq x'^ dF{x) for the function F in Example 4. 

35.3 Let F be the step function such that F{t) = n for t e [n, n + 1), n 
an integer. Calculate 

(a) J^xdF{x), (b) J^x^dF{x), 

(c) J^%\'dF{x). 

35.4 Let P(t) = sint for t G [-f , f ]. Calculate 

(a) J^^'xdF{x) (h) j:i%xdF{x). 
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35.5 Let f{x) = 1 for rational x and f{x) = 0 for irrational x. 

(a) Show that if F is continuous on [a, 6] and F{a) < F{b)^ then / 
is not F-integrable on [a, b]. 

(b) Observe / is F-integrable if F is as in Example 1 or 3. 

35.6 Let (/n) be a sequence of F-integrable functions on [a, 6], and suppose 
fn^f uniformly on [a, b]. Show / is F-integrable and 



35.7 Let / and g be F-integrable functions on [a, 6]. Show 

(a) p is F-integrable. 

(b) fg is F-integrable. 

(c) max(/, g) and min(/, g) are F-integrable. 

35.8 Let g be continuous on [a, b] where g{x) > 0 for all x G [a, b] and 
define = J^g{x)dx for t G [a, 6]. Show that if / is continuous, 
then 



35.9 Let / be continuous on [a, 6]. 

(a) Show J^fdF = f{x)[F{b) - F{a)] for some x in [a, b]. 

(b) Show Exercise 33.14 is a special case of part (a). 
35.10 Let F{x) = f{x) = x^ for x G [a, 6] and some positive odd integer n. 



35.11 Here is a "change of variable" formula. Let / be F-integrable on [a, b]. 
Let 0 be a continuous, strictly increasing function on an interval [c, d] 
such that (j){c) = a and (j){d) = b. Define 

g(^u) = f{(t){u)) and G(ii) = F{(j){u)) for G [c, (i]. 
Show ^ is G-integrable and g dG = f dF. 

35.12 Let (iij) be an enumeration of the rationals in [a, b] and let (cj) be a 
sequence of positive integers such that < oo. 

(a) Show F = Y^ CjJuj defines a strictly increasing function on [a, b]. 

(b) At what points is F continuous? 





Show J^fdF= ^[6^^ 
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§36 * Improper Integrals 

The Riemann integral in §32 has been defined only for functions that 
are bounded on a closed interval [a, b]. It is convenient to be able to 
integrate some functions that are unbounded or are defined on an 
unbounded interval. 



36.1 Definition. 

Consider an interval [a, 6) where b is finite or +00. Suppose / is a 
function on [a, b) that is integrable on each [a, d] for a < d < 6, and 
suppose the limit 

rd 



f 

lim / f{x)dx 

d^b- J a 



exists either as a finite number, +00 or —00. Then we define 

rb rd 

I f{x)dx— lim / f{x)dx. (1) 

J a d^b- J a 

If b is finite and / is integrable on [a, 6], this definition agrees with 
that in Definition 32.1 [Exercise 36.1]. If 6 = +oc or if / is not 
integrable on [a, 6], but the limit in (1) exists, then (1) defines an 
improper integral 

An analogous definition applies if / is defined on (a, b] where a is 
finite or —00 and if / is integrable on each [c, 6] for a < c < b. Then 
we define 

rb rb 

/ f{x)dx= lim / f{x)dx (2) 

whenever the limit exists. 

If / is defined on (a, b) and integrable on all closed subintervals 
[c, d], then we fix a in (a, b) and define 

rb rOL rb 

I f{x)dx — I f{x)dx+ / f{x)dx (3) 

J a J a J a. 

provided the integrals on the right exist and the sum is not of the 
form +00 + (—00). Here we agree oo + L^ooifL^ —00 and 
(—00) + L = —00 if L ^ 00. It is easy [Exercise 36.2] to see this 
definition does not depend on the choice of a. 
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Whenever the improper integrals defined above exist and are 
finite, the integrals are said to converge. Otherwise they diverge to 
+00 or to —00. 

Example 1 

Consider f{x) = ^ for x G (0,oo). For d > 1, we have ^ dx = 
logg d, so 

roo 

— dx = lim logg d = +00. 

X d^oo 

This improper integral diverges to +00. For 0 < c < 1, we have 

Ic l^^^ ~ l^ge C, SO 



1 

/ — dx = lim [— loe[^ c] = +00. 



Also we have 



00 ^ 

— = +00. 

0 X □ 



Example 2 

Consider f{x) = x~p for x G [l,oo) and a fixed positive number 
p^l. For d > 1, 



J\-P dx = y^[d^-P - 1]. 



It follows that 

roo 



and 



roo ^ 1 

/ dx = [0 - 1] = if p > 1 

J I 1-p p-1 

/oo 
x~P dx = +00 if 0 < p < 1. 



□ 



Example 3 

We have sin xdx = 1— cos d for all d. The value (1— cos d) oscillates 
between 0 and 2, as d ^ 00, and therefore the limit 

lim / sinxdx does not exist. 



d^ 



00 



0 



§36. * Improper Integrals 333 



Thus the symbol sin x dx has no meaning and is not an improper 
integral. Similarly, sin x dx and sin x dx have no meaning. 
Note the limit 

ra 

lim / sin x dx 



clearly exists and equals 0. When such a "symmetric" limit ex- 
ists even though the improper integral does not, we have 
what is called a Cauchy principal value of Thus 0 is the 
Cauchy principal value of sinxdx, but this is not an improper 
integral. □ 



It is especially valuable to extend Riemann-Stieltjes integrals to 
infinite intervals; see the discussion after Theorem 36.4 below. Let F 
be a bounded increasing function on some interval /. The function 
F can be extended to all of R by a simple device: if / is bounded 
below, define 

F{t) = mi{F{u) :uel} for t< inf /; 

if / is bounded above, define 

F{t) = sup{F('^) \ u e 1} for t> sup/. 

For this reason, we will henceforth assume F is an increasing function 
on all of R. We will use the notations 

F{-oo) = lim F{t) and F{oo) = lim F{t). 

Improper Riemann-Stieltjes integrals are defined in analogy to 
improper Riemann integrals. 



36.2 Definition. 

Suppose / is F-integrable on each interval [a, b] in R. We make the 
following definitions whenever the limits exist: 

fdF^lim / fdF; / f dF ^ lim / f dF. 

*'^oo Jo J-oo a^-oo J„ 
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If both limits exist and their sum does not have the form oo + (—00), 
we define 

/oo rO roo 

fdF^ / fdF+ fdF 
-00 J —00 Jo 

If this sum is finite, we say / is F-integrable on R. If / is F-integrable 
on M for F{t) = t [i.e., the integrals are Riemann integrals], we say 
/ is integrable on M. 

36.3 Theorem. 

// / is F -integrable on each interval [a, 6] and if f{x) > 0 for all 
X G then f is F -integrable on R or else f dF — +00. 

Proof 

We indicate why lim^^-cx) f dF exists, and leave the case of 
lim^^oo /o^ / dF to the reader. Let h{a) = f dF for a < 0, and note 
a' < a <Q implies h{a') > h{a). This property implies lim^^-oo h{a) 
exists and 

lim h{a) — sup{/i(a) : a G (—00,0)}. 
We omit the simple argument. ■ 

36.4 Theorem. 

Suppose — 00 < F(— 00) < F(oo) < 00. Let f be a bounded func- 
tion on M that is F -integrable on each interval [a, 6]. Then f is 
F-integrable on R. 

Proof 

Select a constant B such that \f{x)\ < B for all x G R. Since we 
have F(oo)— F(— 00) < 00, constant functions are F-integrable. Since 
0 < f + B < 25, Theorem 36.3 shows f + B is F-integrable. It follows 
[Exercise 36.10] that f = {f + B) + {-B) is also F-integrable. ■ 

Increasing functions F defined on R come up naturally in prob- 
ability and statistics. In these disciplines, F is called a distribution 
function if we also have F(— 00) = 0 and F(oo) = 1. Of course, 
the function F{t) = t that corresponds to the Riemann integral 
is not a distribution function. Here is how a distribution function 
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comes up in probability. Consider a random experiment with numer- 
ical outcomes; then F{t) can represent the probability the numerical 
value will be < t. Thus F will be right continuous. As a very simple 
example, suppose the experiment involves tossing three fair coins 
and counting the number of heads. The numerical values 0, 1, 2, 
and 3 will result with probabilities |, |, |, and |, respectively. The 
corresponding distribution function is defined in Example 2 of §35, 
page 303, and sketched in Fig. 35.1. 

Frequently a distribution function F has the form 



F{t) = / g{x) dx 

J —oo 



for an integrable function g satisfying g{x) > 0 for all x G M. Then 
g is called a density for F. Note we must have 

/CXO 
g{x) dx — 1. 
-CXO 

If g is continuous, then g{t) = F\t) for all t by Theorem 34.3. 
Example 4 

It turns out that dx = y/n [Exercise 36.7] and hence 



/CXO 
-CXO 



The most important density in probability is the normal density 



which gives rise to the normal distribution 

1 f 



F{t) [ e-^'/2 



see Fig. 36.1. □ 



Exercises 36.1-36.8 below deal only with Riemann integrals. 
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y 





1 










1 — 

1 


normal distribution 



FIGURE 36.1 



Exercises 

36.1 Show that if / is integrable on [a, b] as in Definition 32.1, then 

rd pb 



hm / f{x) dx = f{x) dx. 

d^^- J a J a 



36.2 Show the definition (3) in Definition 36.1 does not depend on the 
choice of a. 

36.3 (a) Show 

/ dx = if 0 < p < 1 and / dx = +00 if p > 1. 

Jo 1 - P Jo 

(b) Show x~^ dx = +0C for all p > 0. 

36.4 Calculate 

(a) lo loge X dx, (b) /^^ dx, 

(c) Jo" W 

36.5 Let / be a continuous function on (a, h) such that f{x) > 0 for all 
X G (a, 6); a can be —00, b can be +oc. Show the improper integral 
fa f^^^ dx exists and equals 

sup J f{x) dx : [c, d] C (a, b) |> . 

36.6 Prove the following comparison tests. Let / and g be continuous func- 
tions on (a, b) such that 0 < f{x) < g{x) for all x in (a, 6); a can be 
—00, b can be +00. 
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(a) If g{x) dx < oo, then f{x)dx < oo. 

(b) If f{x) dx = +00, then g[x) dx = +00. 

36.7 (a) Use Exercise 36.6 to show e~^^ dx < 00. 

(b) Show this integral equals ^/7T. Hint: Calculate the double integral 

dy using polar coordinates. 

36.8 Suppose / is continuous on (a, 6) and \f{x) \ dx < 00; again a can 

be —00, b can be +00. Show the integral f{x) dx exists and is 
finite. 

36.9 Let F be the normal distribution function in Example 4. 

(a) Show that if / is continuous on M and if the improper integral 
J^oo f{^)^~^ d^ exists, then the improper integral f dF 
exists and 



1 

'dF= —= \ j{x)e-''^l^dx. 



Calculate 

(b) x2 dF{x\ (c) e-^ dF{x\ 

(d)/r^|x|dF(a:), (e) /!la:dF(x). 

36.10 Let / and g be F-integrable functions on M. Show is F-integrable 
on M and 



{f + g)dF= / / 

-00 J —00 J —00 



36.11 Show that if / and g are F-integrable on R and if /(x) < g{x) for x 
in R, then f"^ /^iF < gdF. 

36.12 Generalize Exercise 36.6 to F-integrals on R. 

36.13 Generalize Exercise 36.8 to F-integrals on R. 

36.14 Let iuj) be a sequence of distinct points in R, and let (cj) be a 
sequence of nonnegative numbers such that < 00. 

(a) Observe F = Yl^^i^jJuj is an increasing function on R. See 
Example 3 on page 309. 

(b) Show every bounded function / on R is F-integrable and 



f 

J — ( 



^dF = Y^c^f{uj). 



338 6> Integration 



(c) When will F be a distribution function? 

(d) As in Exercise 35.12, if {uj) is an enumeration of the rationals, 
then F is strictly increasing on R. 

36.15 (a) Give an example of a sequence (fn) of integrable functions on 
R where fn{x)dx = 1 for all n and yet /n ^ 0 uniformly 
on R. 

(b) Suppose F is a distribution function on R. Show that if {fn) is a 
sequence of F-integrable functions on R and if fn ^ f uniformly 
on R, then / is F-integrable on R and 
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§37 * A Discussion of Exponents 
and Logarithms 

In this book we have carefully developed the theory, but have been 
casual about using the familiar exponential, logarithmic and trigono- 
metric functions in examples and exercises. Most readers probably 
found this an acceptable approach, since they are comfortable with 
these basic functions. In this section, we indicate three ways to de- 
velop the exponential and logarithmic functions assuming only the 
axioms in Chap. 1 and the theoretical results in later chapters. We 
will provide proofs for the third approach. 

Recall, for x in M and a positive integer n, is the product of 
X by itself n times. For x ^ 0, we have the convention x^ = 1. And 
for X ^ 0 and negative integers —n where n G N, we define x~^ to 
be the reciprocal of x^, i.e., x~^ = (x^)"-*^. 



37.1 Piecemeal Approach. 

This approach starts with Example 2 on page 238 and Exercise 29.15 
where it is shown that x^ is meaningful whenever x > 0 and r is 
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rational, i.e., r G Q. Moreover, 

if h{x) = x^, then h\x) = rx^~^ . 

The algebraic properties x'^x^ = x^^^ and {xyY = x^^^ can be veri- 
fied for r, 5 G Q and positive x and y. For any t G R and x > 0, we 
define 

x^ = sup{x^ : r G Q and r < t} 

and 



This defines x^ for x > 0. It can be shown that with this definition 
x^ is finite and the algebraic properties mentioned above still hold. 
Further, it can be shown that /i(x) = x^ is differentiable and h![x) — 
tx^-^. 

Next we can consider a fixed b > 0 and the function B defined by 
B{x) = for X G M. The function B is differentiable and B^{x) = 
ci)B(x) for some constant C5. We elaborate on this last claim. In view 
of Exercise 28.14, we can write 

i^x-\-h _ hx — ^ 

B\x) = lim = 6^ . lim 



h^O h h^O h 

provided these limits exist. Some analysis shows that the last limit 
does exist, so 

B'{x) = ctB{x) where C5 = lim hb^ - 1]. 

h^O h 

It turns out that c^, = I for a certain 6, known universally as e. 
Since B is one-to-one if 6 ^ 1, B has an inverse function L which 
is named L(y) = log^^. Since B is differentiable. Theorem 29.9 on 
page 237 can be applied to show L is differentiable and 

L\y) = — . 

CbV 

Finally, the familiar properties of log^ can be established for L. □ 



When all the details are supplied, the above approach is very 
tedious. It has one, and only one, merit; it is direct without any 
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tricks. One could call it the "brute force approach." The next two 
approaches begin with some well defined mathematical object [either 
a power series or an integral] and then work backwards to develop the 
familiar properties of exponentials and logarithms. In both instances, 
for motivation we will draw on more advanced facts we believe but 
which have not been established in this book. 

37.2 Exponential Power Series Approach. 

This approach is adopted in two of our favorite books: [16, §4.9] 
and [62, Chap. 8]. As noted in Example 1 of §31, we believe 

k=0 

though we have not proved this, since we have not even defined 
exponentials yet. In this approach, we define 

k=0 

and we define e = ^'(l). The series here has radius of convergence 
+00 [Example 1, §23], and E is differentiable on R [Theorem 26.5]. 
It is easy [Exercise 26.5] to show = E. The fundamental property 

E{x + y)^E{x)E{y) (2) 

can be established using only the facts observed above. Actually [62] 
uses a theorem on multiplication of absolutely convergent series, 
but [16] avoids this. Other properties of E can be quickly established. 
In particular, E is strictly increasing on R and has an inverse L. The- 
orem 29.9 on page 237 assures us L is differentiable and L\y) = ^. 
For rational r and x > 0, was defined in Exercise 29.15. Applying 
that exercise and the chain rule to g{x) = L(x^) — rL{x), we find 
g^{x) = 0 for X > 0. Hence ^ is a constant function. Since ^(1) = 0, 
we conclude 

L^x"^) = rL{x) for r G Q and x > 0. (3) 
For 6 > 0 and rational r, (3) implies 



= E^LiV")) = E{rL{h)). 



342 7. Capstone 

Because of this, we define 

= E{xL(h)) for X G R. 

The famihar properties of exponentials and their inverses [loga- 
rithms!] are now easy to prove. □ 

The choice between the approach just outlined and the next ap- 
proach, which we will present in some detail, is really a matter of 
taste and depends on the appeal of power series. One genuine ad- 
vantage to the exponential approach is that the series in (1) defining 
E is equally good for defining E{z) — for complex numbers z. 

37.3 Logarithmic Integral Approach. 

Let us attempt to solve — f where / never vanishes; we expect 
to obtain E{x) — as one of the solutions. This simple differential 
equation can be written 

f 

7 = « 

In view of the chain rule, if we could find L satisfying L\y) — ^, 
then Eq. (1) would simplify to 

(^o /)' = !, 
SO one of the solutions would satisfy 

L o f{y) = y. 

In other words, one solution / of (1) would be an inverse to L where 
^'{y) — \- But by the Fundamental Theorem of Calculus II [Theo- 
rem 34.3 on page 294], we know such a function L exists. Since we 
also expect L(l) = 0, we define 

ry I 

L{y) = -dt for y G (0,oo). 



We use this definition to prove the basic facts about logarithms and 
exponentials. □ 
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37.4 Theorem. 

(i) The function L is strictly increasing, continuous and differen- 
tiable on (0,00). We have 

L'(^) = i for ^G(0,oc). 

(ii) L{yz) = L{y) + L{z) for y,ze (0, 00). 

(iii) = L{y) - L{z) for y, z e (0, oc). 

(iv) lim^^oo L{y) = +00 and lim^^o+ Hv) = 

Proof 

It is trivial to show the function f{t) = t is continuous on R, so its 
reciprocal j is continuous on (0, 00) by Theorem 17.4. It is easy to 
see L is strictly increasing, and the rest of (i) follows immediately 
from Theorem 34.3. 

Assertion (ii) can be proved directly [Exercise 37.1]. Alterna- 
tively, fix z and consider g{y) = L{yz) — L{y) — L{z). Since ^(1) = 0, 
it suffices to show g\y) = 0 for ^ G (0, 00) [Corollary 29.4]. But since 
z is fixed, we have 

5'(y) = ----o = o. 
yz y 

To check (iii), note L{\) + L{z) = L{\ ■ z) = L(l) = 0, so that 
L(i) = -L{z) and 

I) = L (^y • 1) = L{y) + ^ (^) = Hv) - L{z)- 

To see (iv), first observe L(2) > 0 and L(2^) = n • L(2) in view 
of (ii). Thus lim^^oo ^(2^) = +00. Since L is increasing, it follows 
that lim^^oo ^(2/) = +00. Likewise L(^) < 0 and L((^)^) = n-L(^), 
so lim^^o+ Hu) = ■ 



The Intermediate Value Theorem 18.2 on page 134 shows L maps 
(0, 00) onto R. Since L is a strictly increasing function, it has a 
continuous strictly increasing inverse [Theorem 18.4 on page 137] 
and the inverse has domain R. 
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37.5 Definition. 

We denote the function inverse to L by E. Thus 
E{L{y))^y for y G (0, oo) 

and 

L{E{x)) =x for X G M. 
We also define e = ^'(l) so that j^jdt— 1. 

37.6 Theorem. 

(i) The function E is strictly increasing, continuous and differen- 
tiahle on R. Then 

E\x) = E{x) for X G R. 

(ii) E{u + v)^ E{u)E{v) for u,v 

(iii) lirQa^^oo E{x) = +00 and lima^^_oo E{x) — 0. 

Proof 

All of (i) follows from Theorem 37.4 in conjunction with Theo- 
rem 29.9 on page 237. In particular, 

\i u^v G R, then u = L{y) and v = L{z) for some y^z ^ (0,oc). 
Then u + v = L{yz) by (ii) of Theorem 37.4, so 

E{u + v)^ E{L{yz)) ^ yz ^ E{L{y))E{L{z)) = E{u)E{v). 

Assertion (iii) follows from (iv) of Theorem 37.4 [Exercise 37.2]. ■ 

Consider 6 > 0 and r G Q, say t — ^ where m^n ^ Z and 
n > 0. It is customary to write for that positive number a such 
that = 6^. By (ii) of Theorem 37.4, we have nL{a) = mL{b); 
hence 

= a = E{L{a)) = ^ Q * nL{a)^ " ^ ' ^^w) = E{rL{b)). 

This motivates our next definition and also shows the definition is 
compatible with the usage of fractional powers in algebra. 
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37.7 Definition. 

For b > 0 and x in R, we define 

b"" = E{xL{b)). 
Since L(e) = 1, we have = E{x) for all x G M. 



37.8 Theorem. 

Fix 6 > 0. 

(i) The function B{x) = b^ is continuous and differentiable on M. 
(ii) If b > 1, then B is strictly increasing; if b < 1, then B is 
strictly decreasing. 

(iii) Ifb^ 1, then B maps R onto (0,00). 

(iv) 6^+^ =6^6^ foru.v gR. 

Proof 

Exercise 37.3. ■ 



If 6 ^ 1, the function B has an inverse function. 

37.9 Definition. 

For 6 > 0 and 6^1, the inverse of B{x) = b^ is written log^. The 
domain of log^ is (0, 00) and 

y — X if ^iid only if b^ — y. 

Note logg y = L{y) for y > 0. 

37.10 Theorem. 

Fixb>0, b^l. 

(i) The function log^ is continuous and differentiable on (0,00). 
(ii) If b > 1, log^ is strictly increasing] ifb< 1, log^ is strictly 
decreasing. 

(iii) log^iyz) = log^^ + log^z fory,z G (0,00). 

(iv) log^d) = log5 ^ - log5 z /or ^, z G (0,00). 

Proof 

This follows from Theorem 37.4 and the identity log^?/ = 
[Exercise 37.4]. Note L{b) is negative if 6 < 1. ■ 
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The function E{x) = has now been rigorously developed and, 
as explained in Example 1 of §31, we have 



oo 

k 

kV 



k=0 

In particular, e = J2T=o ^1^^ 
37.11 Theorem. 

e= lim(l + /i)^/^ = lim ( 1 + - 

n^oo \ n 

Proof 

We only need to verify the first equality. Since L'{1) = 1 by 
Theorem 37.4(i), and since L(l) = 0, we have 

1 = L{l + h) -L{l) ^ ^.^ I +h) = \\mL({l + h)^l^ 

h^O h h^O h h^O \ 

Since E is continuous, we can apply Theorem 20.5 on page 158 to 
the function f{h) = L((l + to obtain 

lim (1 + h)^/^ = lim E (l ({1 + h)^/^)) = ^(1) = e. 



37.12 Trigonometric Functions. 

Either approach 37.2 or 37.3 can be modified to rigorously develop 
the trigonometric functions. They can also be developed using the 
exponential functions for complex values since 

sinx = — [e^^ - e~^^l, etc.; 

see [62, Chap. 8]. A development of the trigonometric functions 
analogous to approach 37.3 can proceed as follows. Since we believe 

arcsinx = / (1 -t^)~^'^ dt, 
Jo 

we can define A(x) as this integral and obtain sinx from this. Then 
cosx and tanx are easy to obtain. In this development, the number 
TT is defined to be 2 (1 - t2)-V2 ^t. □ 
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In the exercises, use results proved in Theorem 37.4 and 
subsequent theorems but not the material discussed in 37.1 and 37.2. 



Exercises 

37.1 Prove directly that 

ryz ^ ny ^ nz ^ 

I -dt= -dt^ -dt for y,zG(0,oo). 
Jit Jit Jit 

37.2 Prove (iii) of Theorem 37.6. 

37.3 Prove Theorem 37.8. 

37.4 Consider 6 > 0, 6 7^ 1. Prove log^ V = T$) V ^ (0. 00). 

37.5 Let p be any real number and define f{x) = for x > 0. Show / 
is differentiable and f'{x) = compare Exercise 29.15. Hint: 
fix) = E{pL{x)). 

37.6 Show x'^y'^ = {xyY for p G M and positive y. 

37.7 (a) Show that if B{x) = 6^, then B\x) = (logg6)6^. 
(b) Find the derivative of log^. 

37.8 For x > 0, let f{x) = x^ . Show f'{x) = [1 + log^x] • x^. 

37.9 (a) Show log^ y <y ior y > I. 

(b) Show 

^ < for y > 1. Hint: log y = 2 log ^Jy. 

y Vy 

(c) Use part (b) to prove lim^^oo ^ logg y = 0. This neat little 
exercise is based on the paper [28]. 



§38 * Continuous Nowhere-DifFerentiable 
Functions 

The history of continuous nowhere-differentiable functions is long 
and fascinating. Examples of such functions were constructed as early 
as 1831, by Bernard Bolzano. But a version wasn't published until 
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Karl Weierstrass did so in 1875 [69]; he had given examples in lec- 
tures before that and formally presented his result on July 18, 1872. 
These early examples tended to be of the form J2^=o cos{a^Tix) 

X^^i ^^^^^2^^^ • The delay in publicizing these examples is due 
to the suspicion of mathematicians of the era that the definition of 
"function" should not be so general as to allow such monstrosities. 

Excellent brief accounts are described in William Dunham's 
book [21, Chap. 9] and David Bressoud's book [13, §6.4]. Dun- 
ham asserts that Hermit e, Poincare and Picard were appalled by 
Weierstrass's "pathological example." Bressoud has a quotation from 
Henri Poincare that refers to these abnormal functions as coun- 
terexamples to the "flaws in our forefathers' reasoning...". There 
is also a quote of Hermite referring to the "plague of functions that 
do not have derivatives". He had no idea how bad a plague; see 
Theorem 38.3 on page 350 and the paragraph preceding it. 

An especially thorough and detailed history can be found in 
Johan Thim's Master's thesis [66]. 

Karl Stromberg [65, Example (4.8), page 174] provides an elegant 
variant of van der Waerden's example [68], published in 1930. We 
repeat Stromberg's example almost verbatim because we don't see 
how to improve it. 

38.1 Van der Waerden's Example. 

We provide an example of a continuous function on R that is nowhere 
different iable. Let (j){x) = \x\ for \x\ < 2 and extend it to be 4- 
periodic, i.e., + 4:q) = (/)(x) for all x G R and g G Z. Since the 
graph of (/) has slope ±1 on intervals between even integers, we have 

\cf>{s)-m-\s-t\ (1) 

provided there is no even integer in the open interval {s,t). The 
graph of (/) is similar to that of g in Fig. 25.1 on page 204; in fact, 
= 2^(|) for all X. 
The continuous nowhere-differentiable function / is defined by 

oo 

= ^^e'^e fn{x) ^ 4:-^(t>{rx). 

n=l 
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Since each is continuous and X^^i • 2 < oo, the Weierstrass 
M-test 25.7 on page 205 and Theorem 25.5 show / is continuous 
on R. 

Fix a in R; we will show / is not different iable at a by showing 
there is a sequence (hk) of nonzero numbers satisfying 

hk ^ 0 and lim -^^^ ^ fi^ does not exist. (2) 

Until Eq. (5), the integer A; > 1 is fixed. There exists = ±1 so that 
no even integers lie between 4^ a and 4^a + e^. From (1), we have 

|</)(4'=a + efc)-</)(#a)l = 1- 

In fact, for n < k, there are no even integers between 4^a and 
4'^a + 4:'^~^ek, because if 4'^a < 2q < 4'^a + 4:'^~^ek for some g G Z, 
multiplying through by the integer 4^~^ would yield 4^a < 4^~^-2g < 
4^a + Thus, by (1) again, 

|(/)(4^a + 4^-^efc) - (/)(4^a) | = 4^"^ for 1 < n < A;. (3) 

Since (/) is 4-periodic, we also have 

|(/)(4^a + 4^-^efc) - 0(4^a) | = 0 for n>k. (4) 

Combining (3) and (4) with the definition of we conclude 

\fn{a + 4:~^ek) - fn{a)\ = 4~^ for n < A; and = 0 for n> k. 

We now let /ij^^^ = 4:~^ek so that 

|/^(a + hk) - = 4~^ for n < /c and = 0 for n> k. 

Therefore the difference quotient, 

k 

f{a + hk) - f{a) _ ^ fn{a + hk) - fn{a) 



hk ^ hk 

^j^ Ua + hk)-Ua) ^j.^^^^^ (5) 

n=l ^ n=l 

is an even integer for even k and an odd integer for odd k. Therefore 
the difference quotients in (5) cannot converge, as A; ^ oo. Since 
limjt hk — 0, this proves (2) so that / is not differentiable at a. □ 
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38.2 Remark. 

For later use, note the function (j) in the preceding proof satisfies 
sup{ 10(^)1 : ^ G R} = 2, and for any y in R we have 

\(j){y + h) — (t){y)\ = h for sufficiently small h > 0. (1) 

We've seen that constructing continuous nowhere-different iable 
functions can be a challenge. Now we take a more abstract approach. 
In the discussion after Definition 22.6 on page 183, it is observed that 
the space C(R) of bounded continuous functions on R is a complete 
metric space using the metric 

d{f,g)^snp{\f{y)-g{y)\:yeR} for all f,geC{R). 

Recall from Example 7(b) on page 174 that the irrational numbers 
are much more prevalent than the rational numbers, because the set 
Q is of first category in the complete metric space R. Similarly, as we 
will see in the next theorem, the continuous nowhere-differentiable 
functions are more prevalent than the differentiable ones. One might 
say mathematicians of the 19th century viewed the continuous 
nowhere-differentiable functions as the "irrational functions." 

As just noted, the next theorem shows "most" functions in (7(R) 
are nowhere differentiable. The proof uses the Baire Category Theo- 
rem 21.8 in the enrichment Sect. 21; see page 173. In 1931, S. Banach 
and S. Mazurkiewicz independently published this result in Studia 
Mathematica. 

38.3 Theorem. 

Let V consist of the functions f in C(R) that have a derivative at at 
least one point. Then V is first category in C(R). 

Proof 

Consider / in V. Then for some x in R, the derivative f^{x) exists. 
Choose m so that \x\ < m and < m. There exists 5 in (0, 1) 

so that 

< m - \ f{x)\ for ah h G (0,5). 



f{x-rh)-f{x) 
h 
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Select a positive integer n > m satisfying ^ < S. Then 

X G [— n, n] and \f{x + h)- f{x)\<hn for he (^0,^.(1) 

Thus / belongs to J>^, which is defined to be all / in C(R) such that 
some X in R satisfies (1) above. We have just shown V C U^^^ so 
by the Baire Category Theorem 21.8 on page 173, it suffices to show 
each is closed in C(R) and is nowhere dense in C(R). 

To see J^n is closed, consider a sequence (fk) in converging 
to / in C(R). As noted after Definition 22.6, this means fk ^ f 
uniformly on R. We will show / is in For each A;, there exists x^ 
so that 



Xk e [-n,n] and \fk{xk + h)-fk{xk)\ < hn for h G ^0, ^ . 



(2) 



By the Bolzano- Weierstrass Theorem 11.5, a subsequence of (x^) 
converges to some x in [— to avoid subsequence notation, we 
will assume the sequence (x^) itself converges to x. Since Xk ^ x and 
fk^f uniformly, we have fk{xk + h) f{x + h) for each h G [0, 
see Exercise 24.17 on page 200. For each h in (0, -), we take the limit 
in (2) as /c ^ oo to obtain (1). Hence / belongs to and is 
closed. 

To show J'n is nowhere dense, it suffices to show no ball Br{g) = 
{/ G C(R) : d{f^g) < r} is a subset of any i.e., every such ball 
contains a function in C(R) \ By the corollary to the Weierstrass 
Approximation Theorem 27.5 on page 220, there is a polynomial p 
such that 8up{\g{y) — p{y)\ : y G [—n — l,n + l]}<|, p{—n — 1) = 
g{—n — 1) and p{n + 1) = g{n + 1). The function p on R, defined by 
p{y) — P{y) \y\ < ^ + 1 and p{y) = g{y) for \y\ > n + 1, is in C(R) 
and satisfies d{g,p) < |. We choose K > n so that it also satisfies 
K > sup{|^^(y)| : y G [—n — l,n + 1]}. Then for each x in [— 
the Mean Value Theorem 29.3 on page 233 implies 

\p{x + h) —p{x)\ < hK for sufficiently small h > 0. (3) 

A modification t/j of the sawtooth function (j) in van der Waerden's 
Example 38.1 on page 348 satisfies 

sup{ 1^(^)1 :yGR}< ^ (4) 
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and 

\tl;{x + h) - ip{x)\ > 2Kh for sufficiently small /i > 0, (5) 

for all X in M. In fact, using Remark 38.2, it is easy to check ilj{y) = 
r0(i2i^) works. Since d{p,g) < |, inequality (4) shows ^+'0 belongs 
to Bj.[g). From (5) and (3), we see 

\{p + iIj){x + h) - {p + iIj){x)\ > hK >hn 

for each x G [— n, n] and sufficiently small /i > 0, which shows p + t/j 
cannot be in J>^. ■ 



In Theorem 38.5 below, we give another interesting application 
of the Baire Category Theorem 21.8. It is due to Corominas and 
Sunyer Balaguer [17, 1954]. See also Boas [9, Chap. 1, §10], Phillips 
[52, Chap. 4, §3, Theorem 18], and Donoghue [20, §1.11]. Interesting 
generalizations can be found in [17] and Kriippel [38]. There are 
relatively straightforward versions for holomorphic complex-valued 
functions; see, e.g., Burckel [14, Example 5.64]. 

First, we give an easy result. Henceforth, when we refer to an 
open interval we allow a = — oo and /3 = oo, so that in 

particular {a, /3) may be R. As in Sect. 31, we write /^^^ for the nth 
derivative of /. 

38.4 Proposition. 

Let f be a function on an open interval and suppose there is 

an integer n such that f^^\x) = 0 for all x. Then f agrees with a 
polynomial on («, /3) of degree at most n — 1. 

Proof 

This can be seen by integrating the function /^^^ n times. At 

each step, one obtains a polynomial of one higher degree; see 

Corollary 29.5 and Exercise 29.7. ■ 

We write C^((a, for the space of functions / infinitely differ- 
entiable on i.e., all the derivatives /^^^ exist on Here 

we agree /^^^ — /. 



§38. * Continuous Nowhere-DifFerentiable Functions 353 



38.5 Theorem. 

Suppose f is in C^{{a, ^)), and suppose for each x in there 
is an integer Ux {depending on x) such that f^'^^\x) = 0. Then f is 
a polynomial on 

We begin with a lemma. 

38.6 Lemma. 

Suppose xq is in p and q are polynomials, and f is a function 
defined on an interval containing xq that agrees with p on an interval 
{xQ — h^xo] and agrees with q on an interval [xq^xq + H). Then p = q. 

Proof 

Assume p ^ q^ and let m be the degree of the polynomial p — q. 
Then {p - q)^'^\xo) ^ 0, contradicting p^^^^xo) = /(^^H^o) = 
g(-)(xo). ■ 

Proof of Theorem 38.5 

It suffices to show that / agrees with a polynomial on every closed 
subinterval [c, d] of To see this is sufficient, consider a de- 

creasing sequence (c^) with limit a and an increasing sequence (d^) 
with limit ^5, where ci < di. For each n, let Pn be a polynomial that 
agrees with / on [c^,(i^]. Then each p^ agrees with pi on [ci,(ii]. 
Hence Pn = Pi for all n} It follows that / = on (o^, (3). 

Step 1. In this step, we show that every nondegenerate closed 
subinterval^ / of [c, d] contains an open subinterval J on which / is a 
polynomial. For each > 0, we let = {x ^ I : f^^\x) = 0}. Then, 
by hypothesis / = V^k>Q continuity of the function / 

and all of its derivatives, each Ej^ is closed. By the Baire Category 
Theorem 21.8 on page 173, for some index n, E^ has nonempty 
interior. Thus, for such an index, there is an open subinterval J C E^ 
of / such that f^^\x) = 0 for all x G J. By Proposition 38.4, / agrees 
with a polynomial on J, as claimed. 



^Polynomials that agree on an infinite set are equal; otherwise their difference 
would be a nonzero polynomial with infinitely many zeros. 
^Nondegenerate here means that its endpoints are not equal. 



354 ^' Capstone 



Step 2. In this step, we identify maximal nondegenerate closed 
subintervals of [c, d] on which the restriction of / is a polynomial. For 
any polynomial p that agrees with / on an open interval containing 
a point xo in [c, d] , let 

ttp(^o) = inf{x G [c, xo] - f = p on [x, xq]} 

and 

bp{xo) = sup{x G [xo, d] : f = p on [xq, x]}. 

Let Ip{xo) — [ap(xo), 6p(xo)], and note ap(xo) < bp{xo) and Ip{xo) C 
[c,d]. Then 

(a) Ip{xQ) is the maximal closed subinterval of [c, d] containing xq 
on which / agrees with p; 

(b) {ap{xo)^bp{xo)) is the maximal open subinterval of [c, d] 
containing xq on which / agrees with p; 

(c) The closed intervals Ip{xQ) are either disjoint or identical. 

To check assertion (c), assume /pq(xo) H/p^ (xi) ^ 0, where xq < xi. 
Clearly aj9^ (xi) < 6pq(xo). If 6po(^o) = ap^(xi), then / agrees with 
to the left of this value, and / agrees with pi to the right of this value. 
But then Lemma 38.6 shows — Pi^ so the closed intervals involved 
aren't maximal. Therefore ap^(xi) < 6pq(xo), and the polynomials 
and po agree on the open interval (ap^(xi), 6pq(xo)). Hence po = pi. 
Now / agrees with — Pi on the closed interval [apQ{x{))^bp^{xi)]^ 
so by maximality. 

Therefore /po(^o) = [apo(xo), 6po(^o)] = [ap,(xi),6p,(xi)] = /pi(xi), 
and (c) holds. 

S'te^ 3. Our goal is to show all the closed intervals in Step 2 are the 
same, i.e., all equal [c, d], which would prove the theorem. Assume, on 
the contrary, that there exist xi, X2 in [c, d] and polynomials pi,P2 so 
that /p^(xi) ^ Ip^{x2). We assume xi < X2. Then ^^^(xi) < ap^{x2) 
and we will focus on [6^^ (xi), (^2)], which we will write as [6, a], 
so 

IpA^i) 7^ ^7^2(^2) and [6, a] = [6^, (xi), a^^ (X2)]. (1) 

Consider the nondegenerate closed intervals from Step 2 that are 
subintervals of (6, a). Since these intervals are disjoint, there are only 



§38. * Continuous Nowhere-DifFerentiable Functions 355 



countably many of them. Moreover, there cannot be finitely many of 
them, because if there were, there would be an open interval in (6, a) 
that is disjoint from the finite union of them. By Step 1, there would 
be another closed interval as described in Step 2, a contradiction. 

We relabel the countably infinite disjoint family of maximal open 
intervals in Step 2, that are subsets of (6, a), by (ak^bk). Observe 
\^j.{cik^bk) is dense in [6, a]; otherwise there is a nonempty open in- 
terval in [6, a] \ [Jj^{cik^bk) and by applying Step 1 we could expand 
our family. Let K = [6, a] \ Uit(^^' ^^)' which is clearly closed. Let E 
be the set of endpoints of the intervals [6, a] and all {ak^ hk). Observe 
that E C K. Note that, by (1), b and a are right and left endpoints, 
respectively, of maximal open intervals. 

Step 4. In this step, we show that K is a perfect set, as defined 
in Discussion 2L10 on page 174, i.e., every point x in X is the limit 
of a sequence of points in K \ {x}. Otherwise, for some x in K and 
h > 0 we have K H {x — h,x + h) = {x}. The point x cannot be 
both a left and a right endpoint in E^ so we may assume, say, that 
X is not a left endpoint in E. Then x ^ a and we may suppose that 
+ C (6, a). Since + intersects the dense set Uife[^^'^^]' 
we have (x, x + /i) Pi [a/^;, b]^ ^ 0 for some k. Then ak < x + h and 
X < bk- Since x ^ a^^, x is not in {ak} U (ak^bk) = [ak^bk]- Since 
X < bk^ we have x < ak < x + h and ak belongs to (x, x + h). Thus 
ak G K n (x, X + /i), a contradiction. Thus K is perfect. 

Step 5. In this step, we obtain a contradiction to our hypotheses 
by showing there is xq E K satisfying /(^)(xo) / 0 for all n > 0. 
This will prove the theorem. 

Claim 1. Let J be an open interval in [6, a] satisfying JflK ^ 0, 
and consider an integer n > 0. Then exists an x G J H K such that 
/W(x)^0. 

Assume that J is as specified, but that no satisfies f^^^\x) = 0 
for all X G J n We show by induction 

/ W (x) =0 for n>no and all x eJDK. (2) 

Suppose (2) holds for some n > uq, and consider x ^ JnK. Since K 
is perfect, there is a sequence (x^^) in K\ {x} such that linik Xk = x. 
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Since J is open, we may suppose that all Xk are also in J. Hence 

k^oo Xk — X k^oo Xk — X 

i.e., (2) holds for n + 1. By induction, we conclude that (2) holds as 
stated. 

On the other hand, \i x ^ J \ K then x belongs to one of the 
maximal open intervals {a^^ bk). Since J D K ^ 0, there exists y in 
J \ (ak^bk)^ so that y < or y > b^^ say y > bk- Since x < b^ 
and J is an interval, J also contains bk- Thus bk belongs to J H K. 
Let pk be the polynomial that agrees with / on (ak^bk)- Since x 
is in (ak^bk)^ we have f^^\x) — p^^\x) for all j > 0. If pk is the 
zero polynomial, then clearly f^^^\x) — p^k^\x) — 0. Otherwise, let 
Uk be the degree of the polynomial pk^ so that p^'^^^ is the nonzero 
constant function p^^^\bk)- Since bk is in J H (2) implies that 
rik < no and f^^^\x) = p^^^\x) = 0. Summarizing, f^^^\x) = 0 for 
all X in the open interval J, so / agrees with a polynomial on J by 
Proposition 38.4 and J C Uifc(^^'^^)' contradicting JnK ^ 0. This 
proves Claim 1. 

Since each /^^^ is continuous. Claim 1 implies: 

Claim 2. If n > 0 and J is an open interval in [6, a] satisfying 
JnK ^ 0, then there is an open interval J' so that C nK 
0 and /(^)(^) 7^ 0 for ah x G J' H K.^ 

Applying Claim 2 to J = (6, a), we obtain an open interval Jq so 
that Jo n K ^ 0 and f{x) ^ 0 for x G Jo H Repeated use of the 
claim yields a sequence ( J^) of open intervals so that 

Jo 3 ^ 3 3 ^ 3 ^2 3 • • • , (3) 

each JnDK 7^ 0 and f^^^Xx) 7^ 0 for ah x G J^HK. Since fl^ Jn^K = 
Pl^ JnCiK ^ 0, by Theorem 13.10 there is xq in K that belongs to all 
the intervals J^. Therefore f^^\xo) 7^ 0 for all n > 0; this completes 
Step 5 and the proof of the theorem. ■ 



^The notation J' represents the closure of the interval J' . 
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38.7 Corollary. 

Suppose — oo < a < ^ < oc. // / is continuous on and if f 

satisfies the hypotheses of Theorem 38.5 on (a, (3), then f agrees with 
a polynomial on 

Even though continuous nowhere-differentiable functions are 
plentiful, by Theorem 38.3, the next theorem shows every continuous 
function on R is arbitrarily close to nice functions. 

38.8 Theorem. 

Given a continuous function f onM. {hounded or not) and e > 0^ 
there is a piecewise linear function"^ g and a function in C^(R) 
such that sup{|/(x) — g{x)\ : x G R} < e and sup{|/(x) — : x G 

R} < e. 

Proof 

If you look at pictures of a couple of continuous functions /, as well 
as / + e and / — e, as in Fig. 24.1 on page 195, you might conclude the 
existence of such a piecewise linear function is obvious. The only flaw 
in this thinking is that, as we know, general continuous functions can 
be quite complicated, and impossible to graph. For this reason, we 
include a proof. 

Step 1. If / is continuous on [a, 6] and e > 0, then there is a 
piecewise linear function g on [a, h] satisfying sup{|/(x) — g{x)\ : x G 
[a, 6]} < e. To see this, we use uniform continuity of / to obtain 5 > 0 
so that 

\s — t\<5^ 5,tG[a,6] implies \f{s)—f{t)\<^. 

o 

Select a partition {a — t{) < ti < • • • < = 6} of [a, b] with 
mesh < 6. For each k = l,2,...,n, let ik be the linear function 
satisfying 4(^fc-i) = f{tk-i) and £k{tk) = f{tk)- We write rrik for 
miii{f{tk-i)J{tk)} and Mk for max{/(tfc_i), /(t^^)}. Then for x in 
[tk-i,tk], we have 

rrik - ^ < f{x) < Mk + ^ and Mk - rrik < ^. 



piecewise linear function on an interval is a continuous function that is linear 
on subintervals. 
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Thus f{x) lies between rrik — | and rrik + y. The same is true for 
ik{x), and therefore 

-4(x)| < e for xe[tk-i,tk]. 

The function g on [a, 6], defined by g{x) = ^(a:^) for x in 
satisfies sup{|/(x) — g{x)\ : x G [a, 6]} < e. 

S'te^ 2. Let ^ be a hnear function on an interval [a, 6]. There is 
a monotonic function in C^(R) so that ijj{a) = ^(a), ilj{b) = ^(6), 
all derivatives of at a and 6 are 0, and 

\^{x) - £{x)\ < \£{b) - £{a)\ for all xG[a,6]. (1) 

We begin with the function /i = /i*^ in Exercise 31.4 on page 267. 
Then h{x) = 0 for x < a, h{x) = 1 for x > 6, /i is increasing on [a, 6], 
and all its derivative are 0 at a and at b. In fact, 

h{x) = - 



/(x-a) + /(6-x) 

where / is the function in Example 3 and Fig. 31.1 on page 257. From 
the quotient rule, and writing D for the denominator obtained using 
the quotient rule, we see 

h\x) = [f{b - x)f{x - a) + f{x - a)f{b - x)]/D{x). 

This is nonnegative, so h is increasing. By looking at the right- 
hand derivatives of h at a, and the left-hand derivatives at 6, we 
see /i(^)(a) = = 0 for all n in N.^ Let 

^{x) = £{a) + [l{b) - l{a)] ' h{x) for x G [a, b] . 

Condition (1) holds because, for x in [a, 6], both ip{x) and l{x) lie 
between l{a) and ^(6). 

S'te^ 3. Given a piecewise linear function ^ on [a, b] and e > 0, 
there is a function in C^(R) so that ip{a) = ^(a), '0(6) = ^(6), all 
derivatives of '0 at a and b are 0, and 

sup{|?/^(x) — g{x)\ : X G [a,6]} < e. (2) 



^Regarding why /i, the quotient of two infinitely different iable functions, also is 
infinitely different iable, see Exercise 38.6. 
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As in Step 1, there is a partition {a = to < ti < • • • < = 6} of 
[a,b] such that \g{tk) — g{tk-i)\ < e and such that g agrees on each 
[tk-i^tk] with a hnear function ^j^^, A; = 1, 2, . . . , n. Apply Step 2 to 
each [tk-i,tk] to obtain a function ^pj^ in C^(R) so that ipk{ik-i) — 
£k{tk-i) = g{tk-i) and similarly il^k{tk) = g{tk)i all derivatives at 
tk-i and tk are 0, and 

\i^k{x) - g{x)\ < \£k{tk) -h{tk-i)\ < e for all X G [tk-i,tk]. 

The desired is defined by iIj{x) = i^k{x) for x G [t/^^-i, tj^^^], k = 
1,2,. 

S'te^ 4. Consider a continuous function / on R and e > 0. By 
Step 1, for each k in Z, there is a piecewise linear function g^ on the 
interval [fc. A; + 1] satisfying 

sup{\gk{x) - f{x)\ :xe[k,k + l]}< ^. (3) 

We apply Step 3 to each interval [A:, A: + 1] to obtain i/jj^ in C^(R) so 
that ipk{k) = f{k), tl^kik + I) = /(A: + 1), all derivatives of ijjk are 0 
at k and A: + 1 , and 

sup{\Mx) - 9k{x)\ :xe[k,k + l]} < ^. (4) 

We obtain ^jj in C^(R) by defining '^(x) = i^k{x) for x in [A;, A; + 1], 
G Z. From (3) and (4) we conclude 

sup{|^(x)-/(x)|:xGR}<^<6. 

^ ■ 

38.9 Corollary. 

The space of all bounded piecewise linear functions and the space 
(7^(R) n C(R) of all bounded infinitely differentiable functions on R 
are dense in C(R); using the distance d{f^g) = sup{|/(y) — g{y)\ : 
y G R} defined prior to Theorem 38.3. 

The next result is both a corollary to Theorem 38.8 and a lemma 
for the next result. 

38.10 Lemma. 

Consider continuous f on [a,b], e > 0, and a constant c > 0. 
Then there is a piecewise linear function g on [a, 6] such that 
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sup{|/(x) — g{x)\ : x G [a, 6]} < e anrf t/ie absolute value of the 
slope of each of its linear segments exceeds c. 

Proof 

Before continuing, you might wish to reread the first paragraph of 
the proof of Theorem 38.8. Since, by that theorem, it now suffices to 
consider the case when / itself is a hnear function it will be easy 
to see why this lemma is true. 

It suffices to consider the case when i is increasing, and we may 
assume c exceeds the slope of £. There is a 5 > 0 sufficiently small 
that one can replace any line segment from (x, i{x)) to £{x+6)) 
by two line segments, one rising from with slope exceeding 

c, to the line ^+ |, and the other dropping down to (x + 5, /(x + 5)), 
at a slope less than — c. By replacing 5 by a smaller 5, if necessary, 
we may assume 6 divides b — a. Then there is partition {to = a < 
ti < • • • < tn = b} oi [a, 6], with tk = tk-i +S for each A;, so that each 
line segment from {tk-i^i{tk-i)) to {tk^i{tk)) can be replaced by 
two line segments each with slope exceeding c in absolute value. The 
resulting piecewise linear function^ g on [a, b] is continuous because 
it agrees with / = ^ at each tk^ and it satisfies 

sup{|^(x) - f{x)\ : X G [a,6]} = I < e. 

This establishes the lemma. ■ 

We now return to continuous nowhere-differentiable functions. 
So far as we know, until 1992 the construction of such functions 
has involved summing certain continuous functions, i.e., building 
them up from simpler functions. The next construction, due to Mark 
Lynch [44] in 1992, is quite different, using some topology and no infi- 
nite series. Lynch starts with certain subsets of the plane and shrinks 
them down to the graph of a continuous nowhere-differentiable func- 
tion. He uses Example 6 on page 171, which states that a function 
on a compact subset of R is continuous if and only if its graph is 
compact. Later Lynch [45] generalized his technique to construct 
continuous functions that are different iable only at the rationals. 



It is tempting to call this a "stegosaurus linear function.' 
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Below, we simplify the technique in [45] just to obtain a continuous 
nowhere-differentiable function. 

38.11 Mark Lynch's Construction. 

Step 1. Let ^ be a linear function on an interval [a, b]. Then its graph 
L is a line segment in the plane. We assume the slope of i exceeds 2n 
in absolute value. We will construct a (closed) rhomboid^ R about 
L with the following property: 

Property R^: If / is a function on [a, b] and if the graph of 
/ is contained in R, then for each x G [a, b] there is ^ G [a, b] 
such that X y and |/M^ZM| y 

First, we suppose the slope exceeds 2n. Let m — be the midpoint 
of the interval [a, 6]. Then we have 

£{b) - £{m) _ £{m) - £{a) 

b — a b — a ' 

thus there exists e > 0 so that 

b — a b — a 

The desired rhomboid R is bounded above and below by the graphs 
of ^ + e and £ — e, and bounded on the left and right by the vertical 
line segments connecting (x, £{x) — e) and (x, £{x) + e) for x = a and 
for X — b. Consider x in [a, b]. If x < m, then using (1) we obtain 

fih) - fix) ^ e{b)-e-[£{x)+e] ^ £{b) - e - [£{m) + e] ^ 
b — X ~ b — a ~ b — a ' 

so Property holds with y — b. li x > then 

fix) - fja) ^ ijx) - e - [ija) + e] ^ ijm) - e - [ija] + e] ^ 
X — a b — a b — a 

and Property holds with y — a. 

Now suppose the slope of £ is less than —2n. Then use —£ to 
obtain a rhomboid R' satisfying Property R^. Let R = —R' . li the 



^For us, a rhomboid is a parallelogram with unequal adjacent angles. 
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Line i has slope >2. 



Solid nonvertical lines 
have slope > 4 or <-4 




FIGURE 38.1 



graph of / is contained in R, then the graph of — / is contained in 
R\ and Property holds for — / and i?^ So it holds for / and R. 

Step 2. Now we construct a continuous nowhere-differentiable 
function on [0, 1]. We begin with a piecewise linear function gi on 
[0, 1] such that the absolute value of the slope of each segment ex- 
ceeds 2. Note gi can be selected to be linear on [a, 6], as illustrated 
in Fig. 38.1, and observe the x and y axes are not drawn to scale. 
Let Ci be the union of rhomboids surrounding the line segments of 
^1, where each rhomboid satisfies Property R^ for n = 1. Then Ci 
satisfies the following property for n = 1. 

Property n: If / is a function on [0, 1] and if the graph of / 
is contained in Cn^ then for each x G [0, 1] there is 7/ G [0, 1] 



such that 0 < 1^ — x| < ^ and 



y-x 



> n. 



For the inductive construction, suppose we have Ci, . . . , Cn-i sat- 
isfying Cn-i ^ • • • ^ Ci, where each Ck is a union of rhomboids 
satisfying Property k. By Lemma 38.10, there is a piecewise linear 
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function on [0, 1] whose graph hes in the interior of Cn-i such 
that the absolute value of the slope of each segment exceeds 2n. By 
breaking segments of into smaller segments, if necessary, we may 
assume their domains, i.e., their projections onto the x-axis, each 
have length < ^. By Step 1, each such segment of gn is included in 
a rhomboid satisfying Property R^, with the additional conclusion 
0 < \y — x\ < ^. Therefore Cn satisfies Property n. Moreover, since 
the graph of gn lies in the interior of Cn-i^ the construction in Step 1 
shows (using a smaller e if necessary) we can select the rhomboids 
so that their union Cn is a subset of Cn-i and so that the vertical 
line segments in Cn have length < ^. 

Now let C = n'^^iCn- Each set Cn is a closed and bounded 
set in the plane, hence compact. By Theorem 13.10 on page 89, C 
is compact and nonempty. Also, for each x in [0,1], the sets {y G 
[0, 1] : (x, y) G Cn} are compact and nonempty and, since the vertical 
line segments in Cn have length < -, their intersection {y G [0, 1] : 
(x, y) G C} has exactly one point. Thus C is the graph of a function / 
on [0, 1]. Since its graph is compact. Example 6 on page 171 shows / is 
continuous. Finally, consider x in [0, 1]. For each n, using Property n 



Exercises 

38.1 Why hasn't anyone constructed a nowhere-differentiable continuous 
function by simply finding a suitably complicated Taylor series? 

38.2 Show that if / is a function on R and /^^^ is a polynomial for some n, 
then / is itself a polynomial. 

38.3 Show that there is a differentiable function on R whose derivative is 
nowhere differentiable. 

38.4 If / is nowhere differentiable and g is differentiable on R, must f -\- g 
be nowhere differentiable? 

38.5 Consider continuous nowhere-differentiable functions / and g on R. 
(a) Must f -\- g he nowhere differentiable? 



we obtain yn in [0, 1] so that 0 < 1^^^ — 
Thus / is not differentiable at x. 



x\ < ^ and 




> n. 



□ 
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(b) Show fg need not be nowhere different iable. Hint: Let / be a 
nowhere-differentiable function satisfying d{f^ 1*) < 1, where 1* 
denotes the constant function identicahy equal to 1 on M. Explain 
why the reciprocal ^ of / is nowhere-differentiable on R. 

38.6 In Exercise 31.4 it was noted, without proof, that the sum, product, 
etc. of infinitely differentiable functions is again infinitely differen- 
tiable. Also, f / g is infinitely differentiable if both / and g are, and if 
g never vanishes. Verify the last claim. Hint: Show the nth derivative 
of f / g has the form hn/g'^ where hn is infinitely differentiable. 
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Consider a set S. The notation x E S means x is an element of 
S; we might also say "x belongs to S"' or "x is in 5." The notation 
X ^ S signifies x is some element but x does not belong to S. By 
T C S we mean each element of T also belongs to 5, i.e., x G T 
implies x e S. Thus we have 1 G N, 17 G N, -3 ^ N, ^ ^ N, \/2 ^ N, 
I G Q, ^ G R, 72 G R, \/2 ^ Q, and TT G R. Also we have NCR, 
Q C R, and R C R. 

Small finite sets can be listed using braces { }. For example, 
{2,3,5,7} is the four-element set consisting of the primes less than 
10. Sets are often described by properties of their elements via the 
notation 

{ : }• 

Before the colon the variable [n or x, for instance] is indicated and 
after the colon the properties are given. For example, 

{n : n G N and n is odd} (1) 

represents the set of positive odd integers. The colon is always read 
"such that," so the set in (1) is read "the set of all n such that n is 
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in N and n is odd." Likewise 

{x : X G R and 1 < X < 3} (2) 

represents the set of all real numbers greater than or equal to 1 and 
less than 3. In §4 this set is abbreviated [1,3). Note that 1 G [1,3) but 
3 ^ [1,3). Just to streamline notation, the expressions (1) and (2) 
may be written as 

{n G N : n is odd} and {x eR : 1 < x < 3}. 

The first set is then read "the set of all n in N such that n is odd." 

Another way to list a set is to specify a rule for obtaining its 
elements using some other set of elements. For example, {n? : n G N} 
represents the set of all positive integers that are the square of other 
integers, i.e., 

{n^ : n G N} = {m G N : m = for some n G N} = {1,4, 9, 16, 25, . . .}. 

Similarly {sin ^ : n G N} represents the set obtained by evaluating 
sin ^ for each positive integer n. Actually this set is finite: 

r nvr ^.1 f \/2 \/2 1 

{sm-:neN} = |^,l,0,-^,-l|. 

The set in (1) can also be written as {2n — 1 : n G N}. One more 
example: {x^ : x > 3} is the set of all cubes of all real numbers 
bigger than 3 and of course equals {^ G M : ^ > 27}, i.e., (27, oo) in 
the notation of §5. 

For sets 5 and T, 5 \ T signifies the set {x G 5 : x ^ T}. For 
a sequence {A^) of sets, the union UA^ and intersection HA^ are 
defined by 

An = {x : X G An for at least one n}, 
An = {x : X G An for all n}. 

The empty set 0 is the set with no elements at all. Thus, for example, 
{n G N : 2 < n < 3} = 0, {r G Q : = 2} = 0, {x G M : x^ < 
0} 0, and [0, 2] H [5, oo) = 0. 

For functions / and ^, the notation /+^, fog^ etc. is explained 
on page 128. 

The end of a proof is indicated by a small black box. This replaces 
the classical QED. 
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Notice. These hints and answers should be consulted only after serious 
attempts have been made to solve the problems. Students who ignore this 
advice will only cheat themselves. 

Many problems can be solved in several ways. Your solution need not 
agree with that given here. Often your solution should be more elaborate. 

1.1 Hint: The following algebra is needed to verify the induction step: 



1.3 Hint: Suppose the identity holds for n. Then work on the right side 
of the equation with n+1 in place of n. Since {x^y^ = x^+2a;?/+y^, 



(1+2+- • - + (71+1))^ = (1+2+- • • n)^+(n+l)^ = 1^+2^+- • -^{n^lf . 
1.5 Hint: 2 - ^ + ^ = 2 - 

1.7 Hint: 7^+^ - 6(n + 1) - 1 = 7(7^ - 6n - 1) + 36n. 



n(n + l)(2n + 1) 
6 



+ (n + l)2 = (n + 1) 




+ n + l = ••• 



(n + l)(n + 2)(2n + 3) 
6 



(1 + 2 + • • • + n + (n + 1)) = (1 + 2 + • • • + n)^ 

+2(n + l)(l + 2 + ---n) + (n + l)^ 

Use Example 1 to show the second line has sum (n + 1)^; hence 
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1.9 (a) n > 5 and also n = 1. 

(b) Clearly the inequality holds for n = 5. Suppose 2^ > for 
some n > 5. Then 2^+^ = 2 • 2^ > 2n^ so 2^+^ > (n + 1)^ 
provided 2n^ > (n + 1)^ or > 2n + 1 for n > 5. In fact, this 
holds for n > 3, which can be verified using calculus or directly: 
> 3n = 2n + n > 2n + 1. 
1.11 (a) Hint: If + 5n + 1 is even, then so is (n + 1)^ + 5(n + !) + ! = 
+ 5n + 1 + [2n + 6]. 
(b) is false for all n. Moral: The basis for induction (Ii) is crucial 
for mathematical induction. 
2.1 Hint: Imitate Example 3. You should, of course, verify your asser- 
tions concerning nonsolutions. Note there are 16 rational candidates 
for solving — 24 = 0. 
2.3 Hint: \/2 + \/2 is a solution of -Ax^ ^2 = 0. 
2.5 Hint: [3 + V2]^^^ is a solution of x^ - 22x^ + 49 = 0. 
2.7 (a) Show x = \/4 -j- 2\/3 — \/3 satisfies the quadratic equation x'^ + 
2xy/3 — 1 — 2^/3 = 0. Alternatively, start with the observation 
(V4 + 2a/3)2 =4 + 2v^= 1 + 2V^ + 3 = (l + v^)^. 
(b) 2. 

3.1 (a) A3 and A4 hold for a G N, but 0 and -a are not in N. Like- 
wise M4 holds for a G N, but is not in N unless a = 1. 
These three properties fail for N since they implicitly require 
the numbers 0, —a and to be in the system under scrutiny, 
namely N in this case, 
(b) M4 fails in the sense discussed in (a). 

3.3 (iv) Apply (iii), DL, A2, A4, (ii) and A4 again to obtain 

{-a){-b) + {-ab) = {-a){-b) + {-a)b= {-a)[{-b) + b] 

= (-a)[6+ (-6)] = (-a) •0 = 0 = a6-t- (-a6). 

Now by (i) we conclude (—a) (—6) = ab. 
(v) Suppose ac = be and c 7^ 0. By M4 there exists such that 
c- = 1. Now (supply reasons) 

a = a-1 — a{c-c~^) = {ac)c~^ = {bc)c~^ = b{c-c~^) = 6-1 = b. 

3.5 (a) If |6| < a, then -a < so -a < -\b\ < b < \b\ < a. Now 

suppose — a < 6 < a. If 6 > 0, then |6| = 6 < a. If 6 < 0, then 
\b\ = —b < a; the last inequality holds by Theorem 3.2 (i) since 
-a < b. 
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(b) By (a), it suffices to prove —\a — b\ < \a\ — \b\ < \a — b\. Each 
of these inequaUties fohows from the triangle inequality: |6| = 
\{b — a) -\- a\ < \b — a\-\- \a\ = \a — b\-\- \a\ which implies the ffist 
inequality; \a\ = |(a — + < |a — + which implies the 
second inequality. 
3.7 (a) Imitate the answer to Exercise 3.5(a). 

(b) By (a), \a — b\ < c if and only if — c < a — 6 < c, and this 
obviously holds [see 04] if and only ifb — c<a<b-\-c. 
4.1 If the set is bounded above, use any three numbers > supremum of 
the set; see the answers to Exercise 4.3. The sets in (h), (k) and (u) 
are not bounded above. Note the set in (i) is simply [0, 1]. 
4.3 (a) 1; (c) 7; (e) 1; (g) 3; (i) 1; (k) No sup; (m) 2; (o) 0; (q) 16; 

(s) ^; (u) No sup; (w) In (s), note 1 is not prime. 
4.5 Proof Since sup S is an upper bound for we have sup S > s 
for all s G S. Also sup S G S by assumption. Hence sup S is the 
maximum of 5', i.e., sups' = max 5'. 
4.7 (a) Suppose S C T. Since supT > t for all t G T we obviously 
have supT > s for all s e S. So supT is an upper bound for 
the set S. Hence supT is > the least upper bound for S', i.e., 
supT > sup S. A similar argument shows inf T < inf S; give it. 
(b) Since S C S' U T, sup 5 < sup(6' U T) by (a). Similarly 
supT < sup(5' U T), so max{sup5', supT} < sup(5' U T). Since 
sup (5' U T) is the least upper bound for S' U T, we will have 
equality here provided we show: maxjsup 5*, sup T} is an up- 
per bound for the set S U T. This is easy. If x G S*, then 
X < sups' < maxjsup 5, supT} and if x G T, then x < 
supT < maxjsup 5', sup T}. That is, x < maxjsup 5*, sup T} 
for allxe SUT. 

4.9 (1) If 5 G S', then —s G —5', so —s < sq. Hence we have s > —sq 
by Theorem 3.2(i). 
(2) Suppose t < s for all s G S. Then —t > —s for all 5 G S', i.e., 
—t>x for all X G —S. So —t is an upper bound for the set —S. 
So —t > sup(— 5'). That is, —t > sq and hence t < —sq. 
4.11 Proof By 4.7 there is a rational ri such that a < ri < b. By 4.7 
again, there is a rational r2 such that a < r2 < ri. We continue by 
induction: If rationals ri , . . . , have been selected so that a < < 
Tn-i < • • • < r2 < ri, then 4.7 applies to a < to yield a rational 
r^+i such that a < r^+i < r^. This process yields an infinite set 
{ri,r2,...} inQn(a,6). 
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Alternative Proof Assume Qn (a, b) is finite. The set is nonempty 
by 4.7. Let c = min(Q fl (a, 6)). Then a < c, so by 4.7 there is a 
rational r such that a < r < c. Then r belongs to Qfl (a, 6), so c < r, 
a contradiction. 

4.13 By Exercise 3.7(b), we have (i) and (ii) equivalent. The equivalence 

of (ii) and (iii) is obvious from the definition of an open interval. 
4.15 Assume a < 6 + ^ for all n G N but a > b. Then a — 6 > 0, and 
by the Archimedean property 4.6 we have no{a — b) > 1 for some 
no G N. Then a > b -\- ^ contrary to our assumption. 
5.1 (a) (-00,0); (b) (-oc,2]; (c) [0,oo); (d) (-^8,78). 
5.3 Hint: The unbounded sets are in (h), (k), (1), (o), (t) and (u). 
5.5 Proof Select sq G S. Then inf S < 5o < supS* whether these 

symbols represent ±oc or not. 
5.7 Use Exercise 5.4 and the fact -{A-^ B) = {-A) + {-B). 
6.1 (a) If 5 < then clearly 5* C T. Conversely, assume s* C T but 
that s > t. Then t G 5* but t ^t* ^ a contradiction, 
(b) s = t \i and only if both s < t and t < s if and only if both 
5* C t* and t* C s* if and only if s* = t* . 
6.3 (a) If r G ce and 5 G 0*, then r -\- s < r, so r + 5 G a. Hence 
Q/ + 0* C Q/. Conversely, suppose r e a. Since ce has no largest 
element, there is a rational t ^ a such that t < r. Then r — t is 
in 0*, so r = t + (r - t) G a + 0*. This shows a C a + 0*. 

(b) — = {r G Q : 5 0 for some rational 5 < — r}. 
6.5 (b) No; it corresponds to v^. 

(c) This is the Dedekind cut corresponding to \/2- 

' --L V'^y 4' 7' 10 ' 13 ' 16 

V*^/ 3' 9' 9' 81' 243 

7.3 (a) converges to 1; (c) converges to 0; (e) does not converge; (g) 
does not converge; (i) converges to 0; (k) does not converge; (m) 
converges to 0 [this sequence is (0, 0, 0, . . .)]; (o) converges to 0; (q) 
converges to 0 [see Exercise 9.15]; (s) converges to |. 
7.5 (a) Has limit 0 since Sn = 1/(V^^ + 1 + n). 

(c) V4n^ + n — 2n = n/ (\/4n^ + n + 2n) and this is close to 2n+2n 
for large n. So limit appears to be |; it is. 
8.1 (a) Formal Proof Let e > 0. Let TV = ^. Then n > N implies 



(b) Discussion. We want n~^/^ < e or ^ < or < n. So 

for each e > 0, let TV = You should write out the formal 

proof. 
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(c) Discussion. We want If^ip^ ~ fl ^ ^ I (3n+2)-3 1 < ^ o^" 
3(3n+2) ^ ^ ^ ^ ^ ^ ^ ~ 1 < ^- So set equal 
to ^ - |. 

9e 3 

(d) Discussion. We want (n + 6)/(n^ — 6) < e; we assume n > 2 
so that absolute values can be dropped. As in Example 3 we 
observe n + 6 < 7n and — 6 > ^n^ provided n > 3. So 
it suffices to get 7n/(^n^) < e [for n > 3] or ^ < n. So try 
iV = max{3, 

8.3 Discussion. We want -y/s^ < e or Sn < e^. But Sn 0, so we can get 
Sn < for large n. 

Formal Proof Let e > 0. Since > 0 and limsn = 0, there exists 
N so that \sn - 0| < for n > N. Thus Sn < for n > TV, so 
^/s^ < e for n > N. That is, \-s/s^ — 0| < e for n > N. We conclude 
lim y/s^ — 0. 

8.5 (a) Let e > 0. Our goal is to show s — e < Sn < s -\- e for large 
n. Since lima^ = 5, there exists Ni so that |an — s| < e for 
n > TVi. In particular, 

n > Ni implies s — e < an- (1) 

Likewise there exists N2 so that \bn — s\ < e for n > A^2, so 

n > N2 implies 6^ < 5 + e. (2) 

Now 

n > max{7Vi, 7V2} implies 5 — e < < 5^ < < + e; 

hence \s — Sn\ < e. 
(b) It is easy to show lim(— t^) = 0 if limt^ = 0. Now apply (a) to 
the inequalities —tn < Sn <tn- 
8.7 (a) Assume limcos(^) = a. Then there exists TV such that n > N 
implies | cos(^) — a\ < 1. Consider n > N and n + 3 where 
n is a multiple of 6; substituting these values in the inequality 
gives |1 — a| < 1 and | — 1 — a| < 1. By the triangle inequality 

2 = 1(1 - a) - (-1 - a)| < |1 - a| + I - 1 - a| < 1 + 1 = 2, 

a contradiction. 

(b) Assume lim(— l)^n = a. Then there exists TV such that n > N 
implies |(— l)^n — a\ < 1. For an even n > N and for n + 2 this 
tells us \n—a\ < 1 and \n-\-2—a\ < 1. So 2 = \n-\-2—a—{n—a)\ < 
\n -\- 2 — a\ -\- \n — a\ < 2, a contradiction. 
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(c) Note the sequence takes the values ±^ for large n. Assume 



limsin(^) = a. Then there is TV such that 



n > N implies | sin (^-^) — a\ < 



V3 
2 ' 



Substituting suitable n > iV, we obtain 



V3 



< By the triangle inequality 



< ^ and 



V3 = 



< 



2 
2 



< 



V3 



— a 



+ 



a — 



+ 



a/3 



\/3, 



a contradiction. 

8.9 (a) Hint: There exists Nq in N such that > a for n > iVo- 
Assume s = lim Sn and s < a. Let e = a — s and select N > Nq 
so that — 5| < e for n > iV. Show 5^ < a for n > iV; a 
picture might help. 

9.1 (a) hm(^) = lim(l + ^) = lim 1 + lim ^ = 1 + 0 = 1. The sec- 
ond equality is justified by Theorem 9.3 and the third equality 
follows from Theorem 9.7(a). 
(b) lim(3n + 7)/(6n - 5) = lim(3 + 7/n)/(6 - 5/n) = lim(3 + 
7/n)/lim(6-5/n) = (lim3+7-lim(l/n))/(lim6-5-lim(l/n)) = 
(3 + 7 • 0)/(6 — 5 • 0) = ^ . The second equality is justified by The- 
orem 9.6, the third equality follows from Theorems 9.3 and 9.2, 
and the fourth equality uses Theorem 9.7(a). 

9.3 First we use Theorem 9.4 twice to obtain lima?^ = lima^ • lima^ = 



a • lima: 



2 _ 



a • liman • hm an = a ■ a ■ a = 



and 9.2, we have lim(a^ 4an) = hma^ 



a^. By Theorems 9.3 
4 • lim an = a^ + 4a. 



Similarly hm(6^ + 1) = lim 6n • hm 6n + 1 = 6^ -Fl. Since 6^ + 1/0, 
Theorem 9.6 shows limsn = {a^ -t-4a)/(6^ + !)• 
9.5 Hint: Let t = \imtn and show t = {t^ ^ 2)/2t. Then show t = \/2. 



9.7 It has been shown that Sn < y 2/(n 
prove limsn = 0. 

Discussion. Let e > 0. We want Sn 

1) < or 2e 



1) for n > 2, and we need to 



^/2/{n-l) < e or 2/(n - 
Formal Proof. Let e > 0 and let TV : 



2e- 



Sn < ^2/{n - 1) < y2/(2e-2 + 1-1) 



; e, so it suffices to get 
+ 1 < n. 

"^ + 1. Then n > N implies 
e. 
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9.9 (a) Let M > 0. Since limsn = +oo there exists N > Nq such that 
5n > M for n > iV. Then clearly tn > M for n > since 
Sn ^ tn for all n. This shows limt^ = +oo. 
(c) Parts (a) and (b) take care of the infinite limits, so assume 
{sn) and {tn) converge. Since tn — Sn > 0 for all n > iVo, 
\im{tn — Sn) > 0 by Exercise 8.9(a). Hence \imtn — \imsn > 0 
by Theorems 9.3 and 9.2. 
9.11 (a) Discussion. Let M > 0 and let m = inf {tn : n G N}. We want 
Sn -^tn > M for large n, but it suffices to get Sn -\- ra > M or 
Sn > M — m for large n. So select TV so that 5^ > M — m for 
n> N. 

(b) Hint: If limt^ > -co, then mf{tn : n G N} > — oo. Use part (a). 
9.13 If \a\ < 1, then lima^ = 0 by Theorem 9.7(b). If a = 1, then 
obviously lima^ = 1. 

Suppose a > 1. Then ^ < 1, so lim(l/a)^ = 0 as above. Thus 
lim — 0. Theorem 9.10 [with Sn = a^] now shows lima^ = +oc. 
[This case can also be handled by applying Exercise 9.12.] 
Suppose a < —1 and assume lima"^ exists. For even n, > 1 and 
for odd n, < —1. Clearly lima^ = +oc and lima^ = — oc are 
impossible. Assume lim = A for a real number A. There exists TV 
such that — ^41 < 1 for n > TV. For even n this implies A > 0 and 
for odd n this implies A < 0, a contradiction. 

9.15 Apply Exercise 9.12 with Sn = a^/n!. Then L = lim|5n+i/sn| = 
lim = 0, so limsn = 0. 

9.17 Discussion. Let M > 0. We want > M or n > y/M. So let 
N = ^/M. 

10.1 increasing: (c); decreasing: (a), (f); bounded: (a), (b), (d), (f). 
10.3 The equality in the hint can be verified by induction; compare 
Exercise 1.5. Now by (1) in Discussion 10.3 we have 

di dn 9 9 

10.7 Let t = sups'. For each n G N, t — ^ is not an upper bound for S', 
so there exists Sn satisfying t — ^ < Sn < t. Now apply the squeeze 
lemma in Exercise 8.5. 

10.9 (a) 52 = |, 53 = ^, 54 ^. 

(b) First we prove 

0 < Sn-\-i < 5n < 1 for all n > 1. (1) 
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This is obvious from part (a) for n = 1,2,3. Assume (1) holds 
for n. Then s^+i < 1, so 

n+1 2 \ 

since < 1. Since s^+i > 0 we also have 5^+2 > 0. 

Hence 0 < Sn+2 < ^n+i < 1 and (1) holds by induction. 

Assertion (1) shows {sn) is a bounded monotone sequence, so 

(sn) converges by Theorem 10.2. 
(c) Let s = limsn- Using limit theorems we find 5 = limsn+i = 

lim • lims^ = 5^. Consequently 5 = 1 or 5 = 0. But 5 = 1 

is impossible since Sn < \ for n > 2. So s = 0. 
10.11 (a) Show itn) is a bounded monotone sequence. 

(b) The answer is not obvious! It turns out that limtn is a Wallis 

product and has value ^ which is about 0.6366. Observe how 

much easier part (a) is than part (b). 
11.1 (a) 1, 5, 1, 5, 1, 5, 1, 5 

(b) Let aik) = Uk = 2k. Then (an^) is the sequence that takes the 
single value 5. [There are many other possible choices of a.] 

11.3 (b) For (sn), the set 5* of subsequential limits is { — 1, ^, 1}. For 
(tn), S = {0}. For K), S = {0}. For K), S = {-1, 1}. 

(c) lim sup 5n = 1, liminfsn = —1, lim sup = hminft^ = 
lim tn = 0, lim sup Un = hm inf Un = hm Un = 0, lim sup Vn = I, 
lim inf Vn = — 1 . 

(d) {tn) and {un) converge. 

(e) (sn), {tfi)^ {un) and (vn) are all bounded. 
11.5 (a) [0,1]; (b) lim sup = 1, hminfg^ = 0. 
11.7 Apply Theorem 11.2. 

11.9 (a) To show [a, b] is closed, we need to consider a limit 5 of a con- 
vergent sequence {sn) from [a, b] and show s is also in [a, b]. But 
this was done in Exercise 8.9. 
(b) No! (0, 1) is not closed, i.e., (0, 1) does not have the property 
described in Theorem 11.9. For example, tn = ^ defines a 
sequence in (0, 1) such that t = limt^ does not belong to (0, 1). 
11.11 Let t = sups'. There are several ways to prove the result. (1) 
Provide an inductive definition where Sk > max{5/c_i,t — ^} for 
all k. (2) Apply Theorem 11.2 directly. (3) Use the sequence {sn) 
obtained in Exercise 10.7, and show tn = maxjsi, . . . , 5^} defines an 
increasing sequence (tn) in 5' converging to t. 
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12.1 Let UN = infjsn : n > N} and wn = inf{tn • ^ > N}. Then {un) 
and {wn) are increasing sequences and un < wn for all > Nq. 
By Exercise 9.9(c), liminfsn = limi^Ar < limi(;Ar = \immftn- The 
inequality lim sup Sn < hm sup tn can be shown in a similar way or 
one can apply Exercise 11.8. 

12.3 (a) 0; (b) 1; (c) 2; (d) 3; (e) 4; (f) 0; (g) 2. 

12.5 By Exercise 12.4, limsup(— 5^ — tn) < limsup(— 5^) + limsup(— t^), 
so — limsup(— -\-tn)) > — limsup(— 5n) + [— limsup(— tn)]- Now 
apply Exercise 11.8. 
12.7 Let (srij) be a subsequence of {sn) such that linij^oo = +oo. [We 
used j here instead of k to avoid confusion with the given k > 0.] 
Then linij^oo ^^n^ = +oc by Exercise 9.10(a). Since (ksnj) is a 
subsequence of (/cs^), we conclude limsup(/c5n) = +oc. 
12.9 (a) Since liminf tn > 0, there exists Ni such that m = mf{tn n > 
iVi} > 0. Now consider M > 0. Since limsn = +oc, there exists 
N2 such that Sn > ^ for n > N2. Then n > max{iVi, iV2} 
implies Sntn > {^)tn > {^)m = M . Hence lim Sn^n +oc. 
12.11 Partial Proof Let M = liminf \sn+i/sn\ and f3 = liminf Isnl^^""- 
To show M < /3, it suffices to prove Mi < (3 for all Mi < M. Since 



: n > N } > Ml, 



lim inf 




= lim inf < 








N^oo y 





there exists TV such that 



inf 



:n> N \ > Ml. 



Now imitate the proof in Theorem 12.2, but note that many of the 
inequalities will be reversed. 
12.13 Proof of sup A = liminf 5^. Consider iV in N and observe un = 
inf{sn ' n > N} is a number in A, since {n e N : Sn < un} ^ 
{1,2,..., N}. So Un < sup A for all TV and consequently liminf Sn = 
lim Un < sup A. 

Next consider a ^ A. Let Nq = max{n G N : 5^ < < 00. Then 
Sn > a for n > Nq. Thus for N > Nq we have un = infjsn : 
n > N} > a. It follows that liminf Sn = hmiiAr > cl- We have just 
shown that lim inf Sn is an upper bound for the set A. Therefore 
lim inf Sn > sup A. 

13.1 (a) It is clear that di and d2 satisfy Dl and D2 of Definition 13.1. 



If x^y^z G M , then for each j = 1, 2, . . . , /c, 

\xj - Zj\ < \xj - yj\ + \yj - Zj\ < di{x,y) 



diiy.z), 
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so di{x^z) < di{x^y) -\- di{y^ z). So di satisfies the triangle 
inequality and a similar argument works for ^2; give it. 
(b) For the completeness of di we use Theorem 13.4 and the 
inequalities 

di{x,y) < d{x,y) < Vkdi{x,y). 

In fact, if {Xn) is Cauchy for di, then the second inequality 
shows {xn) is Cauchy for d. Hence by Theorem 13.4, for some 
X G we have \imd{xn,x) = 0. By the first inequality, we 
also have \imdi{xn^x) = 0, i.e., {xn) converges to x in the met- 
ric di. For (^2, use the completeness of di and the inequalities 
diix.y) < d2{x,y) < kdi{x,y). 

13.3 (b) No, because d*{x^y) need not be finite. For example, consider 
the elements x = (1, 1,1,.. .) and y = (0, 0, 0, . . .). 

13.7 Outline of Proof Consider an open set C R. Let (g^) be an 
enumeration of the rationals in U . For each n, let 

an = inf{a G M : (a, qn] C [/}, hn = sup{6 G M : [qn, h) C U}. 

Show {a^bn) ^ U for each n and U = U^i(<^n,^n)- Show 

(an, bn) n {am, bm) ^ ^ implies (an, bn) = {am, bm)- 

Now either there will be only finitely many distinct [and disjoint] in- 
tervals or else a subsequence {(<^nfc ? ^nfc)}fc^i of {(<^n, bn)} will consist 
of disjoint intervals for which Ufc^i(^nfc7 ^n^) = U. 
13.9 (a) {i : n G N} U {0}; (b) M; (c) [-\/2, ^2]. 

13.11 Suppose E is compact, hence closed and bounded by Theorem 13.12. 
Consider a sequence {xn) in E. By Theorem 13.5, a subsequence of 
(xn) converges to some x in M^. Since E is closed, x must be in E; 
see Proposition 13.9(b). 

Suppose every sequence in E has a subsequence converging to a 
point in E. By Theorem 13.12, it suffices to show E is closed and 
bounded. If E were unbounded, E would contain a sequence {xn) 
where limd{xn,0) = -Foe and then no subsequence would converge 
at all. Thus E is bounded. If E were nonclosed, then by Proposi- 
tion 13.9 there would be a convergent sequence {xn) E such that 
X = \imXn 0 E. Since every subsequence would also converge to 
X ^ E^ we would have a contradiction. 
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13.13 Assume, for example, that sup£^ 0 E. The set E is bounded, so by 
Exercise 10.7, there exists a sequence (sn) in E where lims^ = sup E. 
Now Proposition 13.9(b) shows sup£^ G a contradiction. 
13.15 (a) F is bounded because d{x,0) < 1 for all x e F where 0 = 
(0, 0, 0, . . .). To show F is closed, consider a convergent sequence 
(a?^^^) in F. We need to show x = limcc^^^ is in F. For each 
j = 1,2,..., it is easy to see lim^^oo ^j^^ = xj. Since each 
x^-^^ belongs to [—1,1], xj belongs to [—1, 1] by Exercise 8.9. It 
follows that X e F. 
(b) For the last assertion of the hint, observe 

^(n)^^(m) implies d(cc^^),cc(^)) < dix^^'^x) + 

dix.x^"^^) < 2 while ^(cc^^), cc^^)) = 2 for m 7^ n. Now show 
no finite subfamily of U can cover {ir(^) : n G N}. 
14.1 (a), (b), (c) Converge; use Ratio Test. 

(d) Diverges; use Ratio Test or show nth terms don't converge to 
0 [see Corollary 14.5]. 



(e) Compare with ^1/ 



2 



(f) Compare with ^ ^. 
14.3 All but (e) converge. 

14.5 (a) We assume the series begin with n = 1. Let Sn = X^jLi % 
and tn = XljLi ^j- We are given lims^ = A and limt^ = B. 
Hence lim(5n + tn) = A -\- B hy Theorem 9.3. Clearly Sn + 
tn = Y^^^iidj + bj) is the nth partial sum for ^{an + ^n), so 

I](ttn + K) = hm(Sn -\-tn) = A-^ B. 

(c) The conjecture is not even reasonable for series of two terms: 
aibi + a2b2 7^ (ai + a2)(6i + 62). 
14.7 By Corollary 14.5, there exists TV such that < 1 for n > N. Since 
p > 1, = ttntt^""^ < an for n > N. Hence XI^at+i converges 
by the Comparison Test, so ^^^^ converges. 

14.9 Hint: Let Nq = max{n e N : an ^ bn} < 00. If n > m > TVq, then 

En Y^''^ 
k^ra — Z^k^m ^k- 

14.11 Assume an+i/^n = r for n > 1. Then a2 = rai, as = r^a2, etc. 

A simple induction argument shows = r^~^ai for n > 1. Thus 

^CLn = Yair^~^ is a geometric series. 
14.13 (a) 2 and -|. 
(b) Note 

1\ /I 1\ /I 1\ /I 1 \ . 1 



27 V2 37 \3 47 n + 17 n + 1 
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since the intermediate fractions cancel out. Hence limsn = 1. 
(d) 2. 

15.1 (a) Converges by Alternating Series Theorem. 

(b) Diverges; note lim(n!/2^) = +00 by Exercise 9.12(b). 
15.3 Hint: Use integral tests. Note 

on 2 Aogn ^ 

lim / — — dx = lim / — du. 

n^ooj^ X[\ogX)P ^^«=^Jlog3 

15.5 There is no smallest po > 1, so there is no single series ^ l/n^° with 

which all series ^l/n^ [p > 1] can be compared. 
15.7 (a) Proof Let e > 0. By the Cauchy criterion, there exists TV 
such that n > m > N implies | Ylk^m <^/c| < f • In particular, 

n > N implies aAr+i + • • • + < ^. 

So n > TV implies 

(n - N)an < ttAT+i H h an < ^. 

If n > 27V, then n < 2(n - TV), so nan < 2(n - N)an < e. This 
proves lim(nan) = 0. 
16.1 (a) In other words, show 

00 

2 + 7- 10"^ +4- 10"^ + V 9- 10"^ = 2 + 7- 10"^ + 5 -10"^ = —. 

^ 4 

The series is a geometric series; see Example 1 of §14. 
(b) 2.750 

16.3 Let A and B denote the sums of the series. By Exercise 14.5, we have 
B — A = ^{bn — an)' Since bn — an > 0 for all n, and bn — an > 0 
for some n, we clearly have B — A > 0. 

16.5 (a) .1250 and .1249; (c) .6; (e) .54 

16.7 No. 

16.9 (a) 7n - 7n+i = J^^^ dt - ^ > 0 since ^ < for all t in 
[n,n + 1). 
(b) For any n, 7^ < 71 = 1. Also 




(c) Apply Theorem 10.2. 
17.1 (a) dom(/+^) = dom(/^) = (— oc, 4], dom(/o^) = [— 2, 2], dom(^o 
/) = (-~,4]. 
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(b) /o^(0) = 2, gof{0) = 4, fog{l) = ^3, gof{l) = 3, fog{2) = 0, 

gof{2) = 2. 

(c) No! 

(d) / o ^(3) is not, but g o /(3) is. 

17.3 (a) We are given f{x) = cosx and g{x) = [p = 4] are continu- 
ous. So ^ o / is continuous by Theorem 17.5, i.e., the function 
g o f[x) = cos^x is continuous. Obviously the function iden- 
tically 1 is continuous [if you do not find this obvious, check 
it]. Hence 1 + cos^ x is continuous by Theorem 17.4(i). Finally 
logg(l + cos^x) is continuous by Theorem 17.5 since this is 
h o k{x) where k{x) = 1 + cos^ x and h{x) = logg x. 
(b) Since we are given sinx and are continuous. Theorem 17.5 
shows sin^ x is continuous. Similarly, cos^ x is continuous. Hence 
sin^ X + cos^ X is continuous by Theorem 17.4(i). Since sin^ x + 
cos^ X > 0 for all x and since x^ is given to be continuous for 
X > 0, we use Theorem 17.5 again to conclude [sin^ x-\-cos^ x]^ 
is continuous. 

(e) We are given sin x and cos x are continuous at each x G M. So 
Theorem 17.4(iii) shows = tanx is continuous wherever 

V / cos X 

cosx 0, i.e., for x odd multiple of ^. 
17.5 (a) Remarks. An e-S proof can be given based on the identity 

Or the result can be proved by induction on m, as fol- 
lows. It is easy to prove g{x) = x is continuous on M. If 
f{x) = x^ is continuous on R, then so is {fg){x) = x^~^^ 
by Theorem 17.4(ii). 

(b) Just use (a) and Theorems 17.4(i) and 17.3. 

17.9 (a) Discussion. Let e > 0. We want 4| < e for \x — 2\ small, i.e., 
we want \x — 2\ ■ \x -^2\ < e for \x — 2\ small. If |x — 2| < 1, then 
|x-f2| < 5, so it suffices to get |x — 2| -5 < e. Set 5 = min{l, |}. 

(c) For e > 0, let J = e and observe 



|x — 0| < S implies 





-0 


X sm — 


\xj 





17.11 If / is continuous at xq and if {xn) is a monotonic sequence in dom(/) 
converging to xq, then we have \imf{xn) = /(^o) by Definition 17.1. 
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Now assume 

if (xn) is monotonic in dom(/) and \imxn = xq^ 
then lim/(xn) = f{xo), 

but / is discontinuous at xq. Then by Definition 17.1, there exists 
a sequence {xn) in dom(/) such that \imxn = xq but {f{xn)) does 
not converge to /(xq). Negating Definition 17.1, we see there exists 
e > 0 such that 

for each TV there is n > satisfying \f{xn) — f{xo)\ > e. (2) 

It is easy to use (2) to obtain a subsequence {xn^) of (^n) such that 

\f{xn,)-f{xo)\>e for all k. (3) 

Now Theorem 11.4 shows (xn^) has a monotonic subsequence {xn^ . )• 
By (1) we have limj^oo /(^n^ . ) = /(^o), but by (3) we have 
l/(^nfc ) ~ /(^o)| > e for all j, a contradiction. 
17.13 (a) Hint: Let x G M. Select a sequence (xn) such that \imxn = 
X, Xn is rational for even n, and Xn is irrational for odd n. 
Then f{xn) is 1 for even n and 0 for odd n, so {f{xn)) cannot 
converge. 
17.15 We abbreviate 

(i) / is continuous at xq, 

(ii) \imf{xn) = f{xo) for every sequence {xn) in dom(/) \ {xq} 
converging to xq. 

From Definition 17.1 it is clear that (i) implies (ii). Assume (ii) 
holds but (i) fails. As in the solution to Exercise 17.11, there is a 
sequence (xn) in dom(/) and an e > 0 such that \imxn = xq and 
\f{xn) — /(^o)| ^ e for all n. Obviously Xn xq for all n, i.e., (xn) 
is in dom(/) \ {xq}. The existence of this sequence contradicts (ii). 

18.3 This exercise was deliberately poorly stated, as if / must have a 
maximum and minimum on [0,5); see the comments following The- 
orem 18.1. The minimum of / on [0, 5) is 1 = /(O) = /(3), but / has 
no maximum on [0,5) though sup{/(x) : x G [0,5)} = 21. 

18.5 (a) Let h = f—g. Then h is continuous [why?] and h{b) < 0 < h{a). 
Now apply Theorem 18.2. 
(b) Use the function g defined by g{x) = x for x e [0, 1]. 

18.7 Hint: Let f{x) = xe^; f is continuous, /(O) = 0 and /(I) = e. 

18.9 Let f{x) = ao + aix + • • • + anX^ where ^ 0 and n is odd. We 
may suppose = 1; otherwise we would work with (l/a^)/. Since 
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/ is continuous, Theorem 18.2 shows it suffices to show f{x) < 0 
for some x and f{x) > 0 for some other x. This is true because 
Hma^^oo f{x) = +OC and hm^^^-oo f{x) = — oc [remember = 1], 
but we can avoid these hmit notions as fohows. Observe 



fix) = X" 



1 + 



ao + CLix + • • • + an-ix 



n-l 



(1) 



Let c = 1 + |ao| + |ai| + 
|ao +aixH ha. 



+ |an-i|. If \x\ > c, then 



ix^-i|<(|ao| + |ai| + 



\xr-' < \x\ 



so the number in brackets in (1) is positive. Now if x > c, then 
x^ > 0, so f{x) > 0. And if x < — c, then x^ < 0 [why?], so 
f{x) < 0. 

19.1 Hints: To decide (a) and (b), use Theorem 19.2. Parts (c), (e), (f) 
and (g) can be settled using Theorem 19.5. Theorem 19.4 can also be 
used to decide (e) and (f); compare Example 6. One needs to resort 
to the definition to handle (d). 

19.3 (a) Discussion. Let e > 0. We want 



y 



x+ 1 y^l 



< e 



y 



(x + i)(^ + i) 



< e 



for \x — y\ small, G [0, 2]. Since x -\- 1 > 1 and y -\- 1 > 1 
for X, y G [0, 2], it suffices to get \x — y\ < e. So we let ^ = e. 
Formal Proof Let e > 0 and let S = e. Then y G [0, 2] and 
\x — y\ < 5 = e imply 



\m-m\ = 



x-y 



{x + l){y+l) 



<\x-y\<e. 



5y—5x 



< 



19.5 



(b) Discussion. Let e > 0. We want \g{x) —g{y)\ = i {2x-i)i2y-i) 
e for \x — y\ small, x > 1^ y > 1. For x, > 1, we have 2x — l > 1 
and 2?/ — 1 > 1, so it suffices to get \5y — 5x\ < e. So let ^ = |. 
You should write out the formal proof. 

(a) tanx is uniformly continuous on [0, ^] by Theorem 19.2. 

(b) tanx is not uniformly continuous on [0, ^) by Exercise 19.4(a), 
since the function is not bounded on that set. 

(c) Let h be as in Example 9. Then {smx)h{x) is a continuous 
extension of (^) sin^ x on (0, tt]. Apply Theorem 19.5. 

(e) is not uniformly continuous on (3,4) by Exercise 19.4(a), 
so it is not uniformly continuous on (3, oc) either. 
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Remark. It is easy to give an e-S proof that is uniformly 
continuous on (4, 00). It is even easier to apply Theorem 19.6. 
We are given / is uniformly continuous on [/c,oo), and / is 
uniformly continuous on [0, /c + 1] by Theorem 19.2. Let e > 0. 
There exist ^1 and 62 so that 

\x-y\< Si, x,y e [k,oo) imply \f{x) - f{y)\ < e, 

\x-y\ <^2, x,ye [O.k^l] imply \f{x)-f{y)\ < e. 

Let 5 = min{l,^i,^2} and show 

\x-y\<S, x,y e [0,0c) imply \f{x) - f{y)\ < e. 

19.9 (c) This is tricky, but it turns out that / is uniformly contin- 
uous on R. A simple modification of Exercise 19.7(a) shows 
it suffices to show / is uniformly continuous on [l,oc) and 
(— oc, — 1]. This can be done using Theorem 19.6. Note we 
cannot apply Theorem 19.6 on M because / is not different iable 
at X = 0; also f is not bounded near x = 0. 
19.11 As in the solution to Exercise 19.9(c), it suffices to show h is 
uniformly continuous on [1, oc) and (— oc, — 1]. Apply Theorem 19.6. 
20.1 lima,^cx)/(^) \im^^Q+ f{x) 1; lim^^^o- /(^) hm^^^-oo 

f{x) = -1; lim^^o f{x) does NOT EXIST. 
20.3 hm^^oo f{x) lima,^_oo f{x) 0; hm^^o+ /(^) lima^^o- 

f{x) lim^^of{x) 1. 
20.5 Let 5' = (0,oc). Then f{x) = 1 for all x ^ S. So for any sequence 
(xn) in 5* we have \im f{xn) = 1. It follows that lim^^^o^ /(^) = 
lim3.^^s/(x) 1, i.e., lim^^o+ /(^) hm^^^oo /(^) L Like- 
wise if 5 = (— oc,0), then lim^^^O'^ f{x) = lim,^.^_^s' f{x) = — 1. 
so lim^^^o- f{x) hm f{x) — — 1 . Theorem 20.10 shows 

lima;^o f{x) does not exist. 
20.7 If {xn) is a sequence in (0, oc) and \imxn = +oc, then lim(l/xn) 
= 0. Since (sinx^) is a bounded sequence, we conclude lim(sinxn)/ 
Xn = 0 by Exercise 8.4. Hence lima^^oo f{x) = 0. Similarly 
lim.j;^_oo f{x) = 0. The remaining assertion is lima^^o = 1 
which is discussed in Example 9 of §19. 
20.9 hm^^^oo f{x) -oc; hm^^o+ f{x) +oc; hm^^o- f{x) -oc; 

lim3,^_cx) f{x) = +oc; lim^^^o f{x) does NOT EXIST. 
20.11 (a) 2a; (c) 3a^ 



(f) 

19.7 (a) 
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20.13 First note that if linia^^^jS f{x) exists and is finite and if /c G M, then 
lim^^ {kf){x) = k • hm^^^^js f{x). This is Theorem 20.4(ii) where 
/i is the constant k and /2 = /• 

(a) The remark above and Theorem 20.4 show 

hm [3f{x) + g{x)'^] = 3 hm f{x) + [ hm g{x)]'^ = 3 • 3 + 2^ = 13. 

x^a x^a x^a 

(c) As in (a), limx^a[^f{x) + ^g{x)] = 25. There exists an open 
interval J containing a such that f{x) > 0 and g{x) > 0 for x G 
J\{a}. Theorem 20.5 applies with S = J\{a}, 3/ + 8^ in place 
of / and with g{x) = y/x to give lima^^^ \/3/(x) + Sg{x) = 
a/25 = 5. 

20.15 Let {xn) be a sequence in (— oc,2) such that limx^ = — oc. We 
contend 

lim(xn-2)-3 =0. (1) 

We apply Exercises 9.10 and 9.11 and Theorems 9.9 and 9.10 to 
conclude lim(— x^) = +oo, lim(2 — Xn) = +oc, lim(2 — Xn)^ = +oo, 
lim(2 — = 0, and hence (1) holds. 

Now consider a sequence (xn) in (2, oc) such that \imxn = 2. We 
show 

\im{xn - 2)"^ +OC. (2) 

Since lim(xn — 2) = 0 and each — 2 > 0, Theorem 9.10 shows 
we have lim(xn — 2)~^ = +oc and (2) follows by an application of 
Theorem 9.9. 

20.17 Suppose first that L is finite. We use (1) in Corollary 20.8. Let e>0. 
There exist Si > 0 and Ss > 0 such that 

a < X < a ^ 5i implies L — e < fi{x) < L + e 

and 

a < X < a -\- Ss implies L — e < fs{x) < L + e. 

If ^ = min{^i, ^3}, then 

a < X < a ^ 5 implies L — e < /2(x) < L + e. 

So by Corollary 20.8 we have lim3,^(j+ f2{x) = L. 

Suppose L = H-oc. Let M > 0. In view of Discussion 20.9, there 

exists S > 0 such that 

a < X < a -\- S implies fi{x) > M. 
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Then clearly 

a < X < a -\- 6 implies f2{x) > M, 

and this shows lima,^(j+ f2{x) = +oc. The case L = — oo is similar. 
20.19 Suppose L2 = lim^^^^s f{x) exists with 5* = (a, 62)- Consider a se- 
quence {xn) in (a, 61) with limit a. Then (xn) is a sequence in (a, 62) 
with limit a, so lim/(xn) = L2. This shows lim^^^^^s f{x) = L2 with 
S = {a,bi). 

Suppose Li = lim^^^s fix) exists with S = (a, 61), and consider a 
sequence {xn) in (a, 62) with limit a. There exists N so that n > N 
implies Xn < bi. Then {xn)'^^N ^ sequence in (a, 61) with limit a. 
Hence lim/(xn) = Li whether we begin the sequence at n = iV or 
n = 1. This shows limg^^^s f{x) = Li with S = (a, 62). 
21.1 Let e > 0. For j = 1, 2, . . . , /c, there exist 5j > 0 such that 

s.teR and \s-t\<Sj imply 1/^(5) - /^(t)! < 

Let S = minjJi, ^2, • • • , ^^/c}- Then by (1) in the proof of Propo- 
sition 21.2, 

x.teR and \s - t\ < S imply d'' {'j{s),j{t)) < e. 

21.3 ffint: Show \d{s^ sq) — d{t^ so)\ < d{s^ t). Hence if e > 0, then 

s,t e S and d{s,t) < e imply 1/(5) - f{t)\ < e. 

By part (a), there is an unbounded continuous real- valued func- 
tion / on E. Show h = j^f^jj is continuous, bounded and does 
not assume its supremum 1 on 

7 is continuous at to if for each to ^ b] and e > 0 there exists 
S > 0 such that 

t e [a, 6] and |t-to| < S imply d*(7(t), 7(^0)) < e. 

Note: If 7 is continuous at each to G [a, 6], then 7 is uniformly 
continuous on [a, 6] by Theorem 21.4. 
Use f{xi,X2) = xi, say. 

This is definitely not obvious, but there do exist continuous 
mappings of [0, 1] onto the unit square. Such functions must be 
"wild" and are called Peano curves [after the same Peano with 
the axioms]; see [16, §5.5] or [55, §6.3]. 



21.5 (b) 
21.7 (b) 



21.9 (a) 

(b) 
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21.11 If Q were equal to n^^t/n, where each Un is open, then fl^^ H 
nrGQ(^^ \ {^}) would be an intersection of a sequence of open sets 
that is equal to the empty set, contrary to Theorem 21.7(a). 

21.13 Suppose CjOf{x) = 0. Given e > 0, there is ^ > 0 so that 

sup{|/(y) - f{z)\ :y,ze{x-S,x^S)} <e. 

Then \f{x) - f{y)\ < e for all y e {x - 6,x ^ S), i.e., \x - y\ < S 
implies \f{x) — f{y)\ < e. So / is continuous at x. The proof that 
continuity of / at x implies ojf{x) =0 is similar. 
22.1 (a) [0,1] is connected but [0,1] U [2,3] is not. See Theorem 22.2. 

Alternatively, apply the Intermediate Value Theorem 18.2. 
22.3 Assume E is connected but E~ is not. Then there exist open sets 
Ui and U2 that separate E~ as in Definition 22.1(a). Show that Ui 
and U2 separate E^ which is a contradiction. Since E satisfies (1) in 
Definition 22.1(a), it suffices to show EnUi ^ 0 and EnU2 ^ 0. 
In fact, if E n Ui = 0, then E~ n {S \ Ui) would be a closed set 
containing E, and it is smaller than E~ since E~ nUi 7^ 0. This 
contradicts the definition of E~ in Definition 13.8, so E nUi 7^ 0. 
Likewise EnU2 ^ 0. 
22.5 (a) Assume open sets Ui and U2 separate E U F as in Defini- 
tion 22.1(a). Consider x G E D F; x belongs to one of the 
open sets, say x G Ui. Select y in {E U F) D 1/2- Then y is in 
E or F, say y e E. Since x e E OUi and y e E 0 U2, these 
sets are nonempty. Thus Ui and U2 separate E, and E is not 
connected, a contradiction, 
(b) No such example exists in M [why?], but many exist in the 
plane. 

22.9 Discussion. Given e > 0, we need ^ > 0 so that 

s.teR and \s - 1\ < S imply d{F{s), F{t)) < e. (1) 

Now 

d{F{s),F{t)) - sup{|s/(x) + (1 - s)g{x) - tf{x) - (1 - t)g{x)\ : x e S} 
= sup{|s/(x) - tf{x) - sg{x) + tg{x)\ \ x ^ S} 
< \s-t\-sup{\f{x)\^\g{x)\:xeS}. 

Since / and g are fixed, the last supremum is a constant M. We may 
assume M > 0, in which case ^ = will make (1) hold. 
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22.11 (a) Let {fn) be a convergent sequence in S. By Proposition 13.9(b), 
it suffices to show / = lim/^ is in f . For each x G S, 

\f{x)\ < \f{x) - fn{x)\ + \fn{x)\ < d{f, /„) + 1. 

Since lim d{f, fn) = 0, we have \f{x)\ < 1. 
(b) It suffices to show C{S) is path-connected. So use 
Exercise 22.9. 

23.1 Intervals of convergence: (a) (-1, 1); (c) [-^, ^]; (e) M; (g) [-|, |). 
23.3 {-^/2, ^). 

23.5 (a) Since \an\ > 1 for infinitely many n, we have sup{|an|^^^ : 
n > TV} > 1 for all N. Thus /3 = limsup lanl^/"" > 1; hence 

(b) Select c so that 0 < c < limsup|an|. Then sup{|an| : n > 
N} > c for all TV. A subsequence (an^) of (a^) has the 
property that Ittn^l > c for all k. Since lan^l^^^^ > (c)^/^'^ and 
lim/e^cx) c^/'^'^ = 1 [by Theorem 9.7(d)], Theorem 12.1 shows 
limsup|anj^/^^ > 1. It follows that /3 = limsup lanr/"" > 1 
[use Theorem 11.8]. Hence R = ^ < 1. 
23.9 (a) Obviously lim/n(0) = 0. Consider 0 < x < 1 and let Sn = 
nx"^. Then Sn+i/^n = (^)^, so lim|5n+i/sn| = X < 1. 
Exercise 9.12(a) shows 0 = limsn = limnx^ = \imfn{x). 
24.1 Discussion. Let e > 0. We want \fn{x) — 0| < e for all x and for 
large n. It suffices to arrange for ^ < e for large n. So consider 
n > = N. 

24.3 (a) f{x) = 1 for 0 < X < 1; /(I) = ^; f{x) = 0 for x > 1. See 
Exercise 9.13. 

(b) {fn) does not converge uniformly on [0, 1] by Theorem 24.3. 
24.5 (a) f{x) = 0 for X < 1 and f{x) = 1 for x > 1. Note fn{x) = 
1/(1 + n/x^) and lim^^oo n/x^ = 0 for x > 1 by Exercise 9.12 
or 9.14. 

(b) fn ^ 0 uniformly on [0,1]. Hint: Show \fn{x)\ < - for x G 
[0,1]. 

(c) Hint: Use Theorem 24.3. 

24.7 (a) Yes. f{x) = x for x < 1 and /(I) = 0. 

(b) No, by Theorem 24.3 again. 
24.9 (a) f{x) = 0 for X G [0,1]. For x < 1, limn^oonx'^ = 0 as in 
Exercise 23.9(a). 

(b) Use calculus to show fn takes its maximum at Thus 
sup{|/„(x)| : X e [0,1]} = fn{^) = {^r+\ As in Exam- 
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pie 8, it turns out lim/n(^^) = 1/e. So Remark 24.4 shows 
(/n) does not converge uniformly to 0. 

(C) Jo fn{x) dx = (^^i)%^2) -^^ = Jo /(^) 

24.15 (a) /(O) = 0 and f{x) = 1 for x > 0. (b) No. (c) Yes. 

24.17 Hint: Use \ fn{xn) - f{x)\ < \fn{xn) - f{xn)\ + \f{xn) - f{x)\. 
25.3 (a) Since = (1 + (cos x)/n)/(2 + (sin^ x)/n), we have /n ^ ^ 



pointwise. To obtain uniform convergence, show 



fn{x) 



2 cos X 



sin^ X 



2(2n + sin"' x) 



< 



2(2n) 



< e 



for all real numbers x and all n > ^. 
(b) ldx=^, by Theorem 25.2. 
25.5 Since fn^f uniformly on S, there exists TV G N such that n > N 
implies \fn{x) — f{x)\ < 1 for all x G S. In particular, we have 
|/Ar+i(:^) - f{x)\ < 1 for X e S. If M bounds I/at+iI on S [i.e., if 
\fN+i{x)\ < M for X G 5'], then M + 1 bounds |/| on S [why?]. 



25.7 Let gn{x) 



' cosnx. Then we have \gn{x)\ < n ^ for x G M and 



25.9 



< oo. So ^ converges uniformly on M by the Weierstrass 
M-Test 25.7. The limit function is continuous by Theorem 25.5. 

(a) The series converges pointwise to on (—1,1) by (2) of Ex- 
ample 1 in §14. The series converges uniformly on [—a, a] by the 
Weierstrass M-Test since < for x G [—a, a] and since 
5]a^ < oc. 

(b) One can show directly that the sequence of partial sums 



)/(l — x) does not converge uni- 



formly on (—1, 1). It is easier to observe the partial sums Sn are 
each bounded on ( — 1, 1), and hence if (sn) converges uniformly, 
then the limit function is bounded by Exercise 25.5. But 
is not bounded on (—1,1). 
25.11 (b) Hint: Apply the Weierstrass M-Test to XI ^n, where hn{x) = 

(!)"5n(x). 

25.13 The series 9k and ^ hk are uniformly Cauchy on S and it suffices 
to show Y{9k + ^/c) is also; see Theorem 25.6. Let e > 0. There exist 
Ni and N2 such that 



n > m > Ni implies 
n> m > N2 implies 



9k{x) 

n 



< - for X e S, (1) 



< - for xeS. (2) 
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Then 



n > m > max{A^i, A^2} implies 



^ {gk + hk){2 



< e for X ^ S. 



25.15 (a) Note fn{x) > 0 for all x and n. Assume (/n) does not converge 
to 0 uniformly on [a, b]. Then there exists e > 0 such that 

for each TV there exists n > N and x G [a, 6] 
such that fn{x) > e. 

We claim 

for each n e N there is Xn G [«, b] where fn{xn) ^ (2) 

If not, there is no G N such that /no(^) < ^ foi" all x G [a, 6]. 
Since {fn{x)) is decreasing for each we conclude /n(^) < e 
for all X G [a, 6] and n > no- This clearly contradicts (1). We 
have now established the hint. 

Now by the Bolzano- Weierstrass theorem, the sequence {xn) 
given by (2) has a convergent subsequence (xn^): Xn^ ^o- 
Since lim/n(xo) = 0, there exists m such that fm{xo) < e. 
Since Xn,^ xq and fm is continuous at xq, we have 

lim/c^oo fm{xnk) = fm{xo) < So there exists K such that 

k> K implies fmixn^) < e- 

li k > maxjiC, m}, then > /c > m, so 

But fn{xn) ^ e for a// n, so we have a contradiction, 
(b) Hint: Show part (a) applies to the sequence gn where gn = 

f ~ fn- 

26.3 (a) Let f{x) = Er=i ^^"^ = ^/(^ " < 1- Then by 

Theorem 26.5 



n=l 



= + 



therefore J^^^^ n^x^ = (x + - x)-^ 

(b) 6 and I . 
26.5 Hint: Apply Theorem 26.5. 

26.7 No! The power series would be different iable at each x G M, but 
/(x) = |x| is not different iable at x = 0. 
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27.1 Let (j) be as in the hint. By Theorem 27.4, there is a sequence {qn) 
of polynomials such that Qn ^ f ^ 4^ uniformly on [0, 1]. Note (j) is 
one-to-one and (j)~^{y) = |5^. Let Pn = Qn ^ - Then each pn is a 
polynomial and Pn ^ f uniformly on [a, 6]. 
27.3 (a) Assume a polynomial p satisfies \p{x) — sinx| < 1 for all x G M. 

Clearly p cannot be a constant function. But \ip is nonconstant, 
then p is unbounded on M and the same is true for p{x) — sinx, 
a contradiction. 

(b) Assume — Xlfc=o ^fe^^l < ^ x G M. For x > 0 we have 



n— 1 n— 1 



\ak\x^ 



and for large x the right side will exceed 1. 
27.5 (a) Bnf{x) = x for all n. Use (2) in Lemma 27.2. 

(b) Bnf {x) = + ^x{l - x). Use (4) in Lemma 27.2. 

28.1 (a) {0}; (b) {0}; (c) {nn : n e Z}; (d) {0,1}; (e) {-1,1}; (f) 
{2}. 

28.3 (b) Since X -a = (xi/3_aV3)(^2/3 ^^1/3^1/3 ^^2/3)^ 

f\a) = lim(x^/^ +ai/^xi/^ +a^/^)-i = {Sa'^'y' = -a'^^' 

x^a 3 

for a ^ 0. 

(c) / is not different iable at x = 0 since the limit lima^^o ^^^^/^ 
does not exist as a real number. The limit does exist and equals 
+0C, which reflects the geometric fact that the graph of / has 
a vertical tangent at (0,0). 

28.5 (c) Let 

g{f{x))-g{fm 

m-f{o) ' 

According to Definition 20.3(a), for lima^^o ^(^) to be mean- 
ingful, h needs to be defined on J \ {0} for some open interval 
J containing 0. But the calculation in (b) shows h is undefined 
at {ttu)-^ for n = ±1,±2,.... 

28.7 (d) f is continuous on R, but is not different iable at x = 0. 

28.9 (b) f{x) =x^^ 13x and g{y) = . Then 

h\x) = g\f{x)) ■ f\x) = 7{x^ + 13x)^ ■ {4x^ + 13). 



28.11 With the stated hypotheses, h o g o f is differentiable at a and {h o 
g o /)'(a) = h'{g o f{a)) ■ g'{f(a)) ■ f'{a). Proof By 28.4, 5 o / is 
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differentiable at a and {g o f)' {a) = g'{f{a)) • f {a). Again by 28.4, 

(ho {go f))'{a) = h'{(g o f)(a)) ■ (g o f)'(a). 

28.13 There exist positive numbers and e so that / is defined on the 
interval (a — ^i, a + ^i) and g is defined on (/(a) — e, /(a) + e). By 
Theorem 17.2, there exists ^2 > 0 so that 

X G dom(/) and |x — a| < 82 imply \f{x) — f{a)\ < e. 

If |x — a| < min{(^i, (^2}, then x G dom(/) and \ f{x) — f{a)\ < e, so 
f{x) e dom(^), i.e., x G dom(^ o /). 
29.1 (a) x=l 

(c) If /(x) = then f\x) = ±1 except at 0. So no x satisfies the 
equation f'{x) = •^^2^{.^]^"'"^ = |. Missing hypothesis: / is not 
differentiable on ( — 1,2), since / is not differentiable at x = 0. 

(e) x = V^ 

29.3 (a) Apply Mean Value Theorem to [0, 2]. 

(b) By the Mean Value Theorem, f\y) = 0 for some y G (1,2). 
In view of this and part (a). Theorem 29.8 shows takes all 
values between 0 and ^. 
29.5 For anya G Mwehave l^^^^ii^l < |x-a|. It follows easily that f (a) 
exists and equals 0 for all a G M. So / is constant by Corollary 29.4. 
29.7 (a) Applying 29.4 to we find f'{x) = a for some constant a. If 
g{x) = f{x) — ax, then g'{x) = 0 for x G /, so by 29.4 there is 
a constant b such that g{x) = b for x G I . 
29.9 Hint: Let f{x) = — ex for x G M. Use to show / is increasing 
on [1, oc) and decreasing on (— oc, 1]. Hence / takes its minimum at 
x = l. 

29.13 Let h{x) = g{x) - f{x) and show h{x) > 0 for x > 0. 

29.15 As in Example 2, let g{x) = x^^^. Since dom(^) = [0, 00) if n is even 

and dom(^) = R if n is odd, we have dom(^) = dom(/i) U {0}. Also 

h = g^. Use the Chain Rule to calculate h' {x). 
29.17 Suppose /(a) = g{a). Then 

h{x)-h{a) , h{x)-h{a) , 
lim — — g [a) and lim -^-^ — = / (a). (1) 

x^a'^ X — Qj x^a~ X — CL 

If also f\a) = g\a)^ then Theorem 20.10 shows h\a) exists and, in 
fact, h'{a) = f{a) = g'{a). 

Now suppose h is differentiable at a. Then h is continuous at a and 
so f{a) hm^,^^- f{x) hm^^«- h{x) h{a) g{a). Hence (1) 
holds. But the limits in (1) both equal h'{a)^ so f'{a) = g'{a). 
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30.1 (a) 2; (b) ^; (c) 0; (d) 1. Sometimes L'Hospital's rule can be 
avoided. For example, for (d) note that 

a/TTx - V^-x 2 

30.3 (a) 0; (b) 1; (c) +oc (d) -|. 
30.5 (a) e^; (b) e^; (c) e. 

31.1 Differentiate the power series for sinx term- by-term and cite 
Theorem 26.5. 

31.3 The derivatives do not have a common bound on any interval 
containing 1. 

31.5 (a) g{x) = f{x^) for x G M where / is as in Example 3. Use in- 
duction to prove there exist polynomials 1 < < n, so 
that 

n 

g^^\x) = J2f^^\^^)Pkn{x) for xGM,n>l. 

31.9 Use Xn = Xn-i — ^T-^J7^^r^5^'^^^^ • To six places, the answer is 

0.739085. As always, use radians. 
31.11 For some C > 0, we have \f\x)\ < C for x in (a, b). Then \f{xn-i)\ < 

\xn — Xn-1 1 • C for all n. Let n ^ oo. 
32.1 Use the partition P in Example 1 to calculate U{f^P) = h^ii?{n + 

lf/{4.n^) and P) = b^{n - l)^n^/{4n^). Conclude U{f) = 

and L{f) = 

32.3 (a) The upper sums are the same as in Example 1, so U{g) = b^/3. 
Show L{g) = 0. 
(b) No. 

32.5 5' is ah the numbers L{f,P), and T is ah U{f,P). 

32.7 Assume f{x) = 0 for all x G [a, 6]. A simple induction shows we may 
assume g{x) = 0 except at one point u G [a, b]. Clearly all lower sums 
L{g^P) = 0, so L{g) = 0. Since u belongs to at most two intervals 
of any partition P, we have 

U{g,P) <2\g{u)\md.x[tk-tk-i]. 

k 

Infer U {g) = 0; hence g = 0 = f. 
33.1 If / is decreasing on [a, 6], then — / is increasing on [a, 6], so — / is 

integrable as proved in Theorem 33.1. Now apply Theorem 33.3 with 

c= -1. 
33.3 (b) 4A^6B 
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33.7 (a) For any set S C [a, b] and xq, yo ^ 5', we have 

fixof - f{yof < \f{xo) + f{yo)\ • \f{xo) - f{yo)\ 

< 2B\f{xo) - f{yo)\ < 2B[M(/, S) - m{f, S)]. 

It follows that M(/2, S) - m(/2, 5') < 2B[M{f, S) - m{f, S)]. 
Use this to show u\p,P) - L{f, P) < 2B[U{f, P) - L{f, P)]. 

(b) Use Theorem 32.5 and part (a). 

33.9 Select m G N so that \ f{x) - fm{x)\ < 2{h-a) ^ ^ Then 

for any partition P 

-{<LU- fm, P) < uif - /„, p) < i. 

Select a partition Pq so that U{frmPo) — P{fm^Po) < f • Since / = 
(/ — /m) + /m7 we can use inequalities from the proof of Theorem 33.3 
to conclude Pq) — L{f^Po) < e. Now Theorem 32.5 shows / 
is integrable. To complete the exercise, proceed as in the proof of 
Theorem 25.2. 

33.11 (a) and (b): Show / is neither continuous nor monotonic on any 
interval containing 0. 

(c) Let e > 0. Since / is piecewise continuous on [|, 1], there is a 
partition Pi of [f,l] such that U{f,Pi) - < f. Like- 
wise there is a partition P2 of [— 1,— |] such that P2) — 
L{f, P2) < f . Let P = Pi U P2, a partition of [-1, 1]. Since 

we conclude U{f^P) — L{f^P) < e. Now Theorem 32.5 shows 
/ is integrable. 
33.13 Apply Theorem 33.9 to / - ^. 

34.3 (a) F{x) = 0 for x < 0; F{x) = x'^ /2 for 0 < x < 1; F{x) = 4x - | 
for X > 1. 

(c) F is differentiable except possibly at x = 1 by Theorem 34.3. 
To show F is not differentiable at x = 1, use Exercise 29.17. 
34.5 F\x) = f{x + 1) - f{x - 1). 
34.9 Use a = 0, 6 = I" and g{x) = sinx. 
35.3 (a) 21; (b) 14; (c) 0. 

35.5 (a) Every upper sum is F{b) — F{a) and every lower sum is 0. Hence 

Upif) = F{b) - F{a) + 0 = Lp{f). 
35.7 (a) Imitate solution to Exercise 33.7. 

(b) and (c): Use hints in Exercise 33.8. 
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35.9 (a) Let m and M be the [assumed] minimum and maximum of / 
on [a,b]. Then J^mdF < f dF < M dF or m < [F{b) - 

^(«)]"^ laf^^ ^ ^' ^PPly Theorem 18.2. 
(b) Consider / and g as in Exercise 33.14, and let F be as in 
Exercise 35.8. By part (a), for some x G [a, h] we have 

f f{t)g{t)dt= [' fdF = f(x)[F{b)-F{a)] = f{x) f g{t)dt. 

J a J a J a 

35.11 Let e > 0 and select a partition 

P = {a = tQ <ti < <tn = h} 

satisfying Urif^P) — LF{f-,P) < e. Let Uk = (l)~^{tk) and 

Q = {c = uo < ui < • ■ ■ < Un = d}. 

Show Ucig^Q) = UfU^P) and Lcig^Q) = LfU.P)- Then 
Ucig^Q) — Lcig^Q) < e, so ^ is G-integrable. The equality of the 
integrals follows easily. 
36.1 Hint: If B bounds |/|, then 



I f{x) dx — f{x) dx 

J a J a 



< B(h-d). 



36.3 (b) Use part (a) and Examples 1 and 2. 

36.7 (a) It suffices to show dx < oo. But < for x > 1 

and dx = -. 

e ^ 

(b) The double integral equals dx]^ ^ and it also equals 



^271 

r dr = TT. 



nOO nZlT nC 

/ / e-'^\dedr = 27r / 
Jo Jo Jo 



36.9 (a) Hint: Use Theorem 35.13. 

(b) 1; (c) +oc; (d) (e) 0. 

36.13 Claim: If / is continuous on M and |/| dF < oo, then / is F- 
integrable. Proof Since 0 < / + |/|, the integral /^[/ + |/|] ^^i^ 
exists, and since / + |/| < 2|/|, this integral is finite, i.e., / + |/| 
is F-integrable. Since — 1/| is F-integrable, Exercise 36.10 shows the 
sum of / + I/I and — 1/| is F-integrable. 

36.15 (a) For example, let fn{x) = ^ for x G [0,n] and fn{x) = 0 
elsewhere. 

(b) Outline of Proof First, / is F-integrable on each [a, b] by 
Exercise 35.6. An elaboration of Exercise 25.5 shows there is 
a common bound B for |/| and all |/n|. Consider any b > 0 
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such that 1 — F{b) < There exists a number N so that 
I /o fdF- /o /„ dF| < f forn > N. Then 



n > N imphes 



fdF- 



fndF 



< e. 



(1) 



In particular, m^n > N implies | fn dF — fm dF\ < 2e, 
so ( fn dF)nen is a Cauchy sequence with a finite limit L. 
From (1) it follows that 



F{b) < —- implies 
2B 



f 

Jo 



fdF-L 



< e, 



so linifc^oo Jq f dF = L. Hence / dF exists, is finite, 
and equals lim„^oo /o°° fn dF. A similar argument handles 
f° fdF. 



37.1 Hint: 



/ -dt- -dt= -dt. 

Ji t t jy t 



37.7 (a) B{x) = E{xL{h)), so by the Chain Rule, we have B' {x) = 

E{xL{b)) • L{b) = L{h)h'^ = (logg6)6^. 
37.9 (r) \og,y = L{y) = J^\dt<y-l<y. 

38.3 Apply the Fundamental Theorem of Calculus 34.3 to a continuous 
nowhere-differentiable function /. 



A Guide to the References 

There are many books with goals similar to ours, including: Bran- 
nan [12], Clark [16], and Pedrick [51]. Zorn [73] is a gentle, well 
written introduction with a strong first chapter on "numbers, sets 
and proofs." Lay [41] also starts with sections on logic and proofs, 
and provides good answers. Abbott [1] appears to be a fine book, 
though lots of the text is left to the exercises. Bauldry [3] is a nice 
book designed for a last course in real analysis for those intending 
to go into teaching. Morgan [47] gives a concise introduction to the 
key concepts. 

Beardon [6] gives a coherent treatment of limits by defining the 
notion just once, in terms of directed sets. Bressoud [13] is a wonder- 



Selected Hints and Answers 395 



ful book that introduces analysis through its history. Gardiner [23] 
is a more challenging book, though the subject is at the same level; 
there is a lot about numbers and there is a chapter on geometry. 
Hijab [32] is another interesting, idiosyncratic and challenging book. 
Note many of these books do not provide answers to some of the 
exercises, though [32] provides answers to all of the exercises. 

Rotman [61] is a very nice book that serves as an intermediate 
course between the standard calculus sequence and the first course in 
both abstract algebra and real analysis. I always shared Rotman's 
doubts about inflicting logic on undergraduates, until I saw Wolf's 
wonderful book [70] that introduces logic as a mathematical tool in 
an interesting way. 

More encyclopedic real analysis books that are presented at the 
same level with great detail and numerous examples are: Lewin and 
Lewin [43], Mattuck [46] and Reed [56]. I find Mattuck's book [46] 
very thoughtfully written; he shares many of his insights (acquired 
over many years) with the reader. 

There are several superb texts at a more sophisticated level: 
Beals [4], Bear [5], Hoffman [33], Johnsonbaugh and Pfaffen- 
berger [34], Protter and Morrey [53], Rudin [62] and Stromberg [65]. 
Any of these books can be used to obtain a really thorough 
understanding of analysis and to prepare for various advanced 
graduate-level topics in analysis. The possible directions for study 
after this are too numerous to enumerate here. However, a reader 
who has no specific needs or goals but who would like an introduc- 
tion to several important ideas in several branches of mathematics 
would enjoy and profit from Garding [24]. 
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Symbols Index 



N [positive integers], 1 
Q [rational numbers], 6 
M [real numbers], 14 
Z [all integers], 6 
e, 37, 344 
M^, 84 

Bnf [Bernstein polynomial], 218 
C{S), 184 

352 

d [a metric], 84 
dist(a,6), 17 
dom(/) [domain], 123 
F-mesli(P), 320 

JF{f,P),UF{f,P),LF{f^P)^ 300 

Ju [jump function at u]^ 301 
lim^^^s /(x), 153 

fix). 

lim^^^cx) f{x), etc., 154 
lims^, Sfi 5, 35,51 
limsupsn, liminfsn, 60,78 
M{f,S),m{f,S), 270 
max 5*, min S, 20 



max(/,^),min(/,^), 128 
mesli(P), 275 
n! [factorial], 6 
(^) [binomial coefficients], 6 
Rn{x) [remainder], 250 
sgn(x) [signum function], 132 
sup6',inf 6', 22,29 
/7(/),L(/), 270 
/7(/,P),L(/,P), 270 
/7f(/),L^(/), 301 

87 

88,171 
f [derivative of/], 224 
/ [extension of /], 146 

[inverse function], 137 

f + gjgj/gjog, 128 

F{t-),F{t+), 299 
/n — ^ / pointwise, 193 
/„ -> / uniformly, 194 
f:S^S*, 164 

^ <5, 35 
{snj^) [subsequence], 66 
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Symbols Index 



^ttn [summation], 95 
Iaf = Iaf(^)d^^ 270, 331 
I' fdF = j'^ f{x)dF{x), 301 
jr^fdF, 334 



[a, 6], (a, 6), [a, 6), (a, 6], 20 

[a, oc), (a, oc), (— oc, 6], etc., 28 

+OC, — oc, 28 

0 [empty set], 366 



Index 



Abel's theorem, 212 
absolute value, 17 
absolutely convergent series, 96 
algebraic number, 8 
alternating series theorem, 108 
Archimedean property, 25 
associative laws, 14 



Baire Category Theorem, 172, 173 
basic examples, limits, 48 
basis for induction, 3 
Bernstein polynomials, 218 
binomial series theorem, 255 
binomial theorem, 6 
Bolzano- Weierstrass theorem, 72 

for R^, 86 
boundary of a set, 88 
bounded function, 133 
bounded sequence, 45 
bounded set, 21 

in R^, 86 

in a metric space, 94 



Cantor set, 89 
Cauchy criterion 

for integrals, 274, 275 

for series, 97 

for series of functions, 205 
Cauchy principal value, 333 
Cauchy sequence, 62 

in a metric space, 85 

uniformly, 202 
Cauchy's form of the remainder of 

a Taylor series, 254 
ceh in R^, 91 
chain rule, 227 
change of variable, 295,330 
closed interval, 20, 28 
closed set, 75 

in a metric space, 88, 171 
closure of a set, 88, 171 
coefficients of a power series, 187 
commutative laws, 14 
compact set, 90 
comparison test 

for integrals, 336 

for series, 98 
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complete metric space, 85 
completeness axiom, 23 
composition of functions, 128 
connected set, 179 
continuous function, 124, 164 

piecewise, 286 

uniformly, 140, 164 
convergence, interval of, 189 
convergence, radius of, 188 
convergent improper integral, 332 
convergent sequence, 35 

in a metric space, 85 
convergent series, 95 
converges absolutely, 96 
converges pointwise, 193 
converges uniformly, 194 
convex set, 182 
cover, 90 
curve, 165 



Darboux integrals, 270 
Darboux sums, 270 
Darboux-Stieljtes sums, 300 
Darboux-Stieltjes integrable 

function, 301 
Darboux-Stieltjes integrals, 301 
decimal expansions, 58, 109, 114 
decreasing function, 108, 235 
decreasing sequence, 56 
Dedekind cuts, 31 
definition by induction, 69 
deMorgan's laws, 93 
dense set in a metric space, 171 
denseness of Q, 25 
density function, 335 
derivative, 223 
diameter of a /c-cell, 91 
differentiable function, 223 
Dini's theorem, 208 
disconnected set, 178 
discontinuous function, 126 
distance between real numbers, 17 



distance function, 84 
distribution function, 334 
distributive law, 14 
divergent improper integral, 332 
divergent sequence, 35 
divergent series, 95 
diverges to +oo or — oc, 51, 95 
divides, 9 

division algorithm, 117 
domain of a function, 123 
dominated convergence theorem, 
288 



e, 37, 344 

is irrational, 117 
equivalent properties, 27 
Euclidean /c-space, 84 
Euler's constant, 120 
exponentials, a definition, 345 
extension of a function, 146 



factor, 9 
factorial, 6 
field, 14 

ordered, 14 
F-integrable function, 301,334 
fixed point of a function, 135 
fixed point theorem, 240 
floor function, 112 
F-mesh of a partition, 320 
formal proof, 39 
function, 123 

fundamental theorem of calculus, 
292, 294 



generalized mean value theorem, 
241 

geometric series, 96 
greatest lower bound, 22 



Index 



407 



half-open interval, 20 
Heine-Borel theorem, 90 
helix, 166 

improper integral, 331 

converges, 332 
increasing function, 235 
increasing sequence, 56 
indeterminate forms, 241 
induction step, 3 
induction, mathematical, 2 
inductive definition, 69 
infimum of a set, 22 
infinite series, 95 
infinitely differentiable function, 
256 

infinity -t-oc, — oo, 28 
integers, 6 

integrable function, 270, 277, 291 

on M, 334 
integral tests for series, 107 
integration by parts, 293, 316 
integration by substitution, 295 
interior of a set, 87, 171 
intermediate value property, 
134, 183 

intermediate value theorem, 134 

for derivatives, 236 

for integrals, 287, 290 
interval of convergence, 189 
intervals, 20, 28 
inverse function 

continuity of, 137 

derivative of, 237 
irrational numbers, 27 

7r, 118 

e, 117 

jump of a function, 299 
/c-cell, 91 

/c-dimensional Euclidean space, 84 



L'Hospital's rule, 242 
least upper bound, 22 
left-hand limit, 154 
Leibniz' rule, 232 
liminf, limsup, 60,78 
limit of a function, 153 
limit of a sequence, 35,51 
limit theorems 

for functions, 156 

for sequences, 46, 52 

for series, 104 
limits of basic examples, 48 
logarithms, a definition, 345 
long division, 110 
lower bound of a set, 21 
lower Darboux integral, 270 
lower Darboux sum, 270 
lower Darboux- St ieltjes integral, 
301 

lower Darboux- St ieltjes sum, 300 
maps, 177 

mathematical induction, 2 
maximum of a set, 20 
mean value theorem, 233 

generalized, 241 
mesh of a partition, 275 
metric, metric space, 84 
minimum of a set, 20 
monic polynomial, 10 
monotone convergence theorem, 
288 

monotone or monotonic sequence, 
56 

monotonic function, 280 
piecewise, 286 

natural domain of a function, 123 
Newton's method, 12,259 
nondegenerate interval, 175 
normal density, 335 
normal distribution, 335 
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nowhere dense 

subset of a metric space, 171 
nowhere-differentiable continuous 
function, 348, 350, 361 

open cover, 89 

open interval, 20, 29 

open set in a metric space, 87 

order properties, 14 

ordered field, 14 

oscillation function, 175 

partial sums, 95 

partition of [a, 6], 270 

parts, integration by, 293, 316 

path, 165, 180 

path-connected set, 180 

Peano Axioms, 2 

perfect set, 174 

TT is irrational, 118 

piecewise continuous function, 286 

piecewise linear function, 357 

piecewise monotonic function, 286 

pointwise convergence, 193 

polynomial approximation 

theorem, 218, 220 
polynomial function, 131 
positive integers, 1 
postage-stamp function, 133 
power series, 187 
prime number, 26 
product rule for derivatives, 226 
proof, formal, 39 



quadratic convergence, 265 
quotient rule for derivatives, 226 



radius of convergence, 188 
ratio test, 99 
rational function, 131 



rational numbers, 6 

as decimals, 115 

denseness of, 25 
rational zeros theorem, 9 
real numbers, 14 
real- valued function, 123 
recursive definition, 57, 69 
remainder of Taylor series, 250 

Cauchy's form, 254 
repeating decimals, 114 
rhomboid, 361 

Riemann integrable function, 277 

Riemann integral, 271,277 

Riemann sum, 276 

Riemann- St ieltjes integral, 321 

Riemann- St ieltjes sum, 321 

right continuous function, 310 

right-hand limit, 154 

Rolle's theorem, 233 

root test, 99 

roots of numbers, 136 

secant method, 12,259 
selection function a, 66 
semi-open interval, 20 
sequence, 33 
series, 95 

of functions, 203 
signum function, 132 
squeeze lemma, 44, 163 
step function, 289 
Stieltjes integrals, 301,321 
strictly decreasing function, 235 
strictly increasing function, 

136,235 
subcover, 90 
subsequence, 66 
subsequential limit, 72 
substitution, integration by, 295 
successor, 1 

summation notation, 95 
supremum of a set, 22 
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Taylor series, 250 
Taylor's theorem, 250, 253 
topology, 87 

of pointwise convergence, 186 
transitive law, 14 
triangle inequality, 18, 84 
two-sided limit, 154 



unbounded intervals, 29 
uniform convergence, 184, 194 
uniformly Cauchy sequence, 
184,202 

uniformly continuous function, 
140, 164 



uniformly convergent series of 

functions, 203 
upper bound of a set, 21 
upper Darboux integral, 270 
upper Darboux sum, 270 
upper Darboux- St ieltjes integral, 

301 

upper Darboux-Stieltjes sum, 300 

van der Waerden's example, 348 

Weierstrass M-test, 205 
Weierstrass's approximation 
theorem, 218, 220 



